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luminance order, for selecting at least one of the plurality of reg.ons accord ng to ^^^J^;'^'^^^^^^^^^^^ \ 

bv the select reoion luminance calculation unit; a target luminance calculation unit for ^^'^"'^^'"9 '"^ 'Jr: 

target average luminance. 
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BACKGROUND OF THE INVENTION 

1 . Field of the Invention: 

5 Tlie presetil invention relates to an automatic exposure control apparatus used for correcting the 

exposure in a video camera or the like. 

2. Description pf the Related Art: ' - ■ — - - 

10 An automatic exposure control ^apparatus used for a video-cannera . or the like regulates a diaphragm so 
as to obtain a constant level of-an output video signal. The following methods are used for the purpose of 
regulating a diaphragm:; an . average value method, a peak value method, and a combination thereof. 
According to the average Value method, an average luminance of an image frame is detected; and 
according to the peak value method, the maximum luminance of an iimage franne is detected. \ • -» 
75 Hereinafter, a conventional automatic exposure control apparatus will be described in detail "with . 

reference to Figure 62' ' ' * , " ^ . 

An image of an^ object is .formed on a pickup element 103 via a lehs 101 and a diaphragm r1 02. The 
pickup element 103 'converts' the image into an electric signal. The electric signal is subjQCted^ to a 
treatment while passing through a signal processing circuit 105 and is output therefrom. At this 4ime, a^ 
20 diaphragm control is performed by using the electric signal from the pickup element 103 as follows: . 

An average vali'je calculation circuit 107 and a peak value calculation circuit 108 respectively <jetect an 
average luminance and -a peak -luminance of an image frame. A diaphragm control circuit 109 drives the 
diaphragm 102 based' on th'd VeBUlts obtained from the average value calculation circuit 107 and the peak 

value calculati6n circjyjt lOS.i ■ ..^ , \' — * ... ... ^ . „ . 

25 However, according to the' average value method, in the case of a large luminance distribution in an 
image frame. ergrrinr'ttTe ease v^ere a human figure is picked up as an object with a bright sky for the 
background, a backlight phenomenon is caused. The reason for this is as follows: 

The average of a luminance distribution of the human figure is lower than the average luminance of the 
entire image frame. Accordingly, the video signal which corresponds to the human figure occupies a lower 
30 part of a distribution of the video signal corresponding to the image frame, resulting in a black reproduced 
image of the human figure. 

In order to avoid the above-mentioned phenomenon, it is required to make the luminance distribution of 
the video signals corresponding to an image of an object (the human figure in this case) present at a higher 
level than an average luminance of an image frame. For example, an image quality in a backlight state can 
35 be improved by correcting the diaphragm in an opening direction so as to keep the video signals 
corresponding to the image of the object at a higher level. 

The following method has been considered to provide a diaphragm control at a predetermined control 
amount; An input switching which is manually switched by a user is provided with the diaphragm drive 
circuit 109. When the user operates the input switch in a backlighting condition, the input switch supplies a 
40 switch signal to the diaphragm control circuit 109. 

However, according to this configuration, a misoperation by the user may cause an improper diaphragm 
control. In addition, since the control amount of a diaphragm is predetermined, it is impossible to provide a 
proper diaphragm control depending on individual images under various conditions. In order to overcome 
these problems, it is required to automatically judge whether an object is under a backlight condition or not, 
45 and to correct the diaphragm control in accordance with the strength of the backlight. 

For example. Japanese Latd-Open Patent Publication No. 2-18578 discloses an automatic diaphragm 
apparatus. According to the apparatus, a luminance of the region where the object is supposed to be 
present (e.g. a central portion of an image frame) and a luminance of the remaining portion of the image 
frame are measured. Based on the difference between these luminances, it is judged whether the object is 
50 under a backlight condition or not. The correction of the diaphragm control is made according to the 
backlight condition. 

The diaphragm control regarding the conventional apparatus mentioned above will be described with 
reference to Figure 63. 

First and second detectors 113 and 114 detect the level of each output signal having data with respect 
55 to a first region (central region of an image frame) and a second region (peripheral region thereof) (see 
Figure 64), output from the pickup element. The signals output from the first and second detectors 113 and 
114 enter a comparator 123 through amplifiers 121 and 122. In the comparator 123, the levels of the first 
and second regions are compared with each other in order to determine the degree of backlight. Assuming 

3 
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that the output signals from the first and second detectors 113 and 114 are x and y. respectively and 
amplification degrees of the amplifiers 121 and 122 are m and n, it is judged that a forward light state is 
obtained in the case of (x.m)k(y n), and a backlight state is obtained in the case of (x.m)<(y.n). 

A first gate portion 110, a second gate portion 111, and a third gate portion 112 detect the level of each 

5 output signal having data with respect to regions ti , tg, and ts as shown in Figure 65. The respective output 
signals pass through gain control units 115, 117, and 119 so as to be integrated at an adding unit 124. The 
amplification degree of the first, second, and third gain control units 115,' 117, and 119 are regul&ted by a 
first, second, and third control units 116, 118, and 120 which receive information with respect to the 
determined degree of backlight from the comparator 123. A diaphragm control circuit 1 09 performs a 

10 diaphragm control so as to keep the output signal from the adding unit 124 at a predetermined 'level. 

When the object is in a frontlight state, the difference in luminance level between the first' (central) 
region and the second -(peripheral) region in Figure 64 is small. Accordingly, the comparator 123 determines 
that it is in a frontlight state. The first, second, and third Control units 116, 118, and 120 set gains G1, G2' 
and G3 in the gain control units 115, 117, and 119 as G1>G2>G3. Here, Gl is slightly larger than G2 and 

76 GS.rThus, a diaphragm control, which is close to the conventional photometry method (i.e., average 
luminanc^ of an image frame is made constant), is performed; ' ' ' ' 

On the other hand, when the object is in a backlight state, the first region becomes darker than the 
second region. Accordingly, the comparator 123 determines that it is in a- backlight state. The iflrst, second 
third control units 116. 118, knd 120 set the gains Gl. G2, a^nd G3 as G1»G2>G3. Here, Gl is remarkably 

20 larger than G2 and G3. This means that the gain of the first region is larger than that of -the second regidr^. 
and therefore the luminance of the first region is measured With emphasis. As a result, it is possible to 

perform a diaphragm control suitable for the backlighl condition. ■ : c- 

However, in the case of th^ above-nientioned diaphragm contror. the Output levels of the respective 
central region and the peripheral region are averaged, even though an image with high contrast is inpul in 

25 an irn'age frame. Therefore, the actual contrast cannot be itieasured. Namely, the output levels oi the central 
region and the- peripheral region change' depending on the difference of the spatial distribution b^^ 
luminance; as a result, most video signals are saturated due to overcorrection, or an image whichis desired 
to be further corrected" cannot be done sd appropWateiy. In additibr^. since thd degree 6f ■backiight changes 
depending on the change of luminance of the central'regibn of 'an'Tma^e frame, the exposiire corredtion 

30 amount may change in accordance with the movement of an object. 

SUMMARY OF THE INVENTION 

The automatic exposure control apparatus of this invention, includes a image frame luminance 
35 calculation unit for calculating an average luminarice of art image fra'rtie; a region lurr^inance calbulation unit 
for calculating average luminances of a plurality of rbgions, the plurality of regions constitutihg the image 
frame; a select region 'luminance calculation unit for arranging the average iumiriances obtained by the 
region luminance calculation unit in the luminance order, for Selecting' at least one of the plurality of regions 
according to the luminance order, and for calculalting kn average lumihince of the selected at least one of 
40 the plurality of regions; a backlight degree calculation unit for calculating a value representing a backlight 
degree based on the average luminance obtained by the select region lumihahde calculation unit; a target 
luminance for an exposure correction calculation unit for calculating a target average luminance based on 
the value; and an exposure correction unit for correcting' an exposure so that the' average luminance 
obtained by the image frame luminance calculation unit Is kept substantially equal to the target average 
45 luminance. " ' ■ - ' '- ■ .. . . ■ ■ 

In another aspect of the present invention, an automatic exposure control apparatus includes a state 
judgment unit for judging 'whether an image frame is in a backlight statfe or in an excessive frontlight state • 
an image frame luminance calculation unit for calculating an average luminance of the image frame- a 
region luminance calculation unit for calculating average luminances of a plurality of regions, the plurality of 

50 regions constituting the image frame; a first select region lumiWance calculation unit for arranging the " 
average -luminances obtained by the region luminance calculation unit" in the lumihance order, for selecting 
at least one of the plurality of regions according to the luminance order, and for calculating an average 
luminance'of those selected from at least one of the^pluralitf of regidnsi a second select region lumihance 
calculation unit for arranging the average luminances ofetSiried by the" region luminance Calculation unit in 

55 ■ the luminance order, for selectihg at least-'another or^e of the jalilrkllty of regions' according to thfei'uminance 
order, and for calculating an average luminance of the seiedted at ieist' another one of the plurality of 
regions; a backlight degree calcutation unit for calculating the' Wst v4lue representing- a -backlight degree 
based on the average luminance obtained by the first selectVegion lumihance calculation unit; an excessive'' 
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frontlight degree calculation unit for calculating the second value representing an excessive frontlight degree 
based on the average luminance obtained by the second select region lunninance calculation unit; a 
correction annount determination unit for determining the correction amount based on the judgment result 
by the state judgment unit, the first value and the second value; a target luminance calculation unit for 

5 calculating the target average luminance based on the correction amount;, and an exposure correction unit 
for correcting an exposure so that the average luminance obtained by the image frame luminance . 
calculation unit is kept substantially, equal to the target average luminance. 

.According tp the present invention, an j mage- frame* is divided intp a plurality of small regions. Ari 
average luminance, of each small region is obtained, and an average value of low luminance regions is 

70 calculated, whereby the degree of backlight under an automatic exposure control is quantitatively obtained. 

In addition, a plurality of average . values of the low luminance regions are obtained, whereby the 
correction amount, of a^diaphragm in accordance with the darkness and size of the low luminance regions 
can be obtained. Z . ' ■ 'i ■ 

Moreover, the Judgment between the backlight and the excessive frontlight is made by comparing 

75 lumihance of the upper region with that of the lower region,, and. a , correction amount of the diaphragm is 
adjusted. The control, level of the diaphragm is, appropriately changed in accordance with the .lighting 
condition on the basis .of thexorrection amount :0t the diaphragm. • : ^ 

.^Furthermore, a- dark region which is part of the iower.r^egion.is added to- the upper region, and the.dark 
region , is removed from the lower region.. In this .yv^y,. the increase of an average lurriinance of, the first 

20 region and .the decrease of .an average luminance.of.the second. region, due. to the movement of an object is- 
suppressed, whereby misjudgments caused by jthe,.rripvemept of the object can be.-avoided. As a result,, an ^ 
appropriate ^exposure for any object which mov^. up. and. down in an excessiye frontlight condition can be 
obt3ined,.. „, , . ^ , , , , .. , ; r/,^'^^ : ^ ... • - , . : , , ; ■ . c; 

Thus, the inver)tiqn,described herein, makes -po?^ of providing. an automatic exposure^ 

25 contrpL'apparatus." which is capable. oKjudging. ^a . lighting condition , of an object and determining the^^,,, 

apprp'priate exposure, foe the object ^f. - - M-n ;v.7h-. . - c - - " • ^ . . ... 

. Thfs and^other advantages of the present Jfiyenti'on will become apparent to those. skilled in .the art upon ^. 
readirig .and.understandin the following. detailed descr^ipifiOA.-with reference to tlie accompanying figures. :^ 

30 BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram showing an automatic exposure control apparatus of Example 1 according 
to the. present invention. , , , . ; • < , - 

Figure 2. shows an image frame divided into small regions., . ■ 

35 . Figure 3 Is a graph showing a luminance., order characteristic curve. - : . 

/Figures 4A through 4.C show backlight innages; and Figures 4D through 4F are graphis shQwihg. 
lumiriance order characteristic curves of the respective backlight images. . . : 

.Figure 5 . is a block diagram showing an automatic exposure control apparatus of- Example 2 according, 
to the present invention, \ .'. . - : . / * - 

40 . Figure 6 is a graph showing a luminance characteristic curve. " . .* 

Figure 7 is a view illustrating a linear multiple function, . - . , . 

Figure 8 is. another view illustrating a N near multiple function. . - , . 

Figure 9 Js still another view illustrating .ja , linear^ multiple-function. : , - , , 

Figure 10 is a block diagram showing an automatic exposure control apparatus of Example 3 according 
45 to the. present invention. . ^ . , . . ;^ - : ' 

Figures. 11A and 1'iB show an image.frame divided i'ntp tvyo regions and that. divided .into srnall regions. 
. Figure 12 is a graph showing a luminance bfder characteristic curve. : i , 

^ Figure 13 is a view illustrating backlight and excessive frontlight based on a. lu mi nance ratio ..tpptween. 
the upper and lower regions of an innage frame. - > : > 

50 Figure 14 is a block diagram showing an automatic exposure control apparatus of Example 4 according' 
to the present invention. ..... . * ' • 

f^igure 15A shbvvs ah excessiye. frontlight image.in which, an object is present at a. central, position D of . 
an irnage frame together with lumiriance sit each position. . . . . - . ; , - 

Figure 158 shows ah excessive frontlighrirriagejnVh^ an opject is present at a top end positiori T of. 
55 the image frame together with lurriinance at each, pqsi , , . • . • • 

'Figure, 15C shows changes of an average lurhi nance of, the upper and lower regions while^^the object. 
moVes .fro nri the central position D to. the top end pos .. , . . • . 
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Figure 16 is a block diagram showing an automatic exposure control apparatus of Example 5 according 
to the present invention. . . 

Figure 17 shows an image frame divided into an upper region, a right region, a left region, and a lower 
central region. 

5 Figure 18A shows an excessive frontlight image in which an object is present at a central position D of 

an image frame together with luminance at each position. 

Figure 18B shows an excessive frontlight image in which an object is present at a top end position T of 
the image frame together with luminance at each position. ' 

Figure 18C is a graph showing changes of an average luminance of the first and second regions while 
10 the object moves from the central position D to the top end position T: ' 

Figure 19A is a. backlight image- in which ah object is present at a central position C together with 
luminance at each position. ^ . - 

Figure 19B is a backlight image in which the object moves fi-om a right position R to a left position L 
together with luminance at each position. 
75 Figure 19C is a graph showing changes of an average luminance of the first and second regions while 

the object moves the right position R to the left position L. ■ : 

Figure 20A shows a backlight image in which an object is present on the right side of an image frame 
together with luminance at each position. ^ : *. . . 

Figure 20B shows a backlight image in. which the object is present on the right side of the image frame 
20 and a dark substance Is present on. the left side thereof together with luminance at each positiohr^ • 

Figure 20C is a graph showing changes of an average luminance of the first ahtf second regions while 
the object: is present on the right side of the image frame and the dark substance moves from the left side 
of the image frame to a boundary position L thereof.- - * * ?. ' ^ 

-Figure 20D is a graph showing changes of an average luminance of the first and second regions^ while 
25 the object is present on the right side of the image: frame and the'dark substance moves from the left side 
of the image frame to the boundary position L thereofi - • " ' ^ ^ " . ^ 

Figure 21 is a block diagram showing an automatic exposure control apparatus of Example 6 according 
to the present invention: — < ■ : t,.. ■. . '^.v: ■ 

Figure 22 shows an image frame divided into an upper region ahd a lower region. ■ ^ 
30 Figure 23A shows an excessive frontlight image in which an object is present at a central position D of 
an image frame together with luminance at each position. 

Figure 238 shows an excessive frontlight image- in whicK^ah object is present at the top end position T 
of the image frame together with luminance at each, position. = 

Figure 23C is a graph showing changes of an average luminance of the first and second regions, and 
35 the upper and lower regions while the object moves from the central position D to the top end position T. ^ 
Figure 24A shows a backlight image in which an object is present at a central position C of an image 
frame together with luminance of each position. 

Figure 248 shows a backlight image in which- an object moves from' a righf position R of an image 
frame to a left position L thereof together with lumihance^of each position. 
40 Figure 24C. is a graph showing changes of an 'average luminance ^of the first and second regions, and 
the upper and lower regions while the object moves the right position R to the ieft^ position L.- 

' Figure 25A shows a backlight image in which an object is present on the right side of an image frame 
together vvith luminance at each position. ' 

Figure 258 shows a backlight image in which the object is present on the right side of the image frame 
45 and a dark substance is present on the left side thereof together with luminance at each positiori. 

Figure 25C is a graph showing changes of an average luminance of the first and second regions, and' 
upper and lower regions while the object is present on the right side of the image frame and the dark 
substance moves from the left side of the image frame to a boundary position L thereof. 
• /^'_gure 26A shows an excessive frontlight image in which ah object is present on the hght 'side of an 
50 image franri'e togethei- with' luminance at each position.'^ ' ■ - ' ' '"^ ■ - 

Figure 268 shows an excessive frontlight image in which the object is present on the right side :0f "the 
image ff-anrie and a bright substance is present in ^the left side ther^^ ; " . 

' Figure 26C is a graph showing changes of an average luminance of the first "and second regions, and 
the upper and lower regions while the object is present on the right side of the image frame and the bright 
55 substance moves from the left side of the image frame to ^ boundary position L thereof.- ' 

' Figure 27A' shows-an excessive frontlight image- divided into a bi-ight area and a dark area together with 
luminance at each position. • : . - ., 
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Figure 27B is a graph showing the relationship between the luminance and the respective regions of 
Figure 27 A. 

Figure 28 is an image frame divided into an upper region, a right region, a left region, and a lower 
central region. . - ■ 

5 Figure 29 is a block diagram showing an automatic exposure control apparatus of Example 7 according 

to the present invention. ' 
Figure 30 is a diagram illustrating the position of each .small region of an image frame. . 
..Figures 31 A and 31 B show an average luminance of each small region when the same image-in which 
the central region is bright is taken under different diaphragm states. , t.i- 

10 Figures 32A and 328 show an average luminance of. each small region by using two values, when the 

same image in which the central region is bright is taken under different diaphragm states. (An average 
luminance of each small region is represented by using two values, based on an average luminance of an 
imago frame as a threshold value.) •« 
Figure 33 is a, diagram showing a predetermined luminance distribution. 
75 Figures 34A and 34B are diagrams showing the respective luminance distributions in image frames 

having a bright central region. • : ■ / : - * - . . ■ 

Figure 35A shows an excessive frontlight image in which an object is present at a central position D of . 
an image frame together with luminance at each position. , • • . . - 

Figure 35B shows an excessive ff-ontMght image jn which the object is present at the top end position T : 
20 of the image, frame together, with luminance lat each -position.; ,, . 

. 'Figures 35C is a graph showing the. correlatipr} valu^e while, the object-moves from the central, position D. • 
to the top end position T as shown in Figures 35A and 35B.- • . • . 

...Figure 35D i^s.-a graph-showing changes of-an averagq luminance of the first and second regions while, 
the^ object moves from the central position D . to the;top;end position as shown, in Figures 35A and 35B. v^^.^ 
25 Figure 36A shows a backlight image in which an object is present .at a central position C together with^i . 

luminance-at. each -position. :y j -.. ; . r^: .^v-.v-: ; - - . : ■ ■ 

Figure 36B shows a backlight image in which an object moves from a right position R of the image^. 
frame to a left position L thereof together with JuminaRce,. at .each position. - 
J Figure- 36C is a graph showing :a change . of .a :CQrrelatiGn value while the object- moves from the right . 
30 position R to the left position L. - - . : . - • 

-Figure 36Djs^a graph showing changes of an average. luminance of the first and second regions whiles 
the object moves the right position R to the left posjtiQn-L: . , . - . . 

Figure 37 is a block diagram showing an, automatic -exposure control apparatus of Example 8 according, , 
to the preseqt^ invention. ■ n _ • - - • - • > ' 

35 Figure 38 shows an image frarne divided into, ari upper region, a right region, a left region, an^j a.lowei;^ 
central region. , • • , 

Figure 39 is. an .image frame diyided:into a central region and a peripheral region. , . . 

Figure 40 is a graph showing the relationship between the correction amount, (of the difference- of an • 
average luminance between the first and secorid .regions) -and the difference q^pf an average.- 1 unni nance 
40 (between the central region and the image. frame). % . : * 

Figure 41. is. a graph, showing the conversion from the luminance difference p/ obtained by correcting 
the difference of an average luminance between the first and second regions with .the. correction amount, . 
into the. correction amount calculation gain g. . 

Figure 42A is an excessive . frontlight .ipnage.m which the central area is bright and the. area excluding 
45 the central. area is dark. ■ ^ . , ' ... . 

• Figure 42B is a diagram showing the lunninance of each- region shown in Figure 42A. - : ; . - , 

Figure 43A shows an excessive frontlight image in which an object is present at a central positiori D of . 
an. image frame together with lunninance at each position... . . - . \ , - - 

Figure 43B shows an excessive frontlight image in which an object is present at -a top end position T of. . 
50 the image^ frame together with luminance at each position.- . • • j . • 

Figure 43C shows changes of an average luminance of -the central region, an average luminance of the 
image frame, and a, correction amount. while the object . nrioves fronn the central position D to- the top^end 
position T as shown, in Figures 43A and. 43B. ; \ . _ , 

Figure 43D shows, changes of -an average luminance.. of the.. first region, an. average luminance of the: 
second region, .and a. corrected .average luminance o.f the, first region while the object moves .fronrt the 
central region D to the top end f. . . - ■ , v 

Figure 44A shows a backlight image in which an object is present at a central position C of an image 
frame together with luminance at each position. 
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Figure 44B shows a backlight image in which an object moves from a right position R of the image 
frame to a left position L thereof together with luminance of each position. 

Figure 44C shows changes of an average luminance of the central region, an average luminance of the 
image frame, and a correction amount while the object moves the right position R to the left position L as 
5 shown in Figures 44A and 44B. 

Figure 44D shows changes of an average luminance of the' first region, an average luminance of the 
second .region, and a corrected average luminance of the first region while the object moves from the right 
position R to the left position L as shown in Figures 44A and 44B. 

Figure 45A is an excessive frontlight image in which the right half area is bright and the left half area is 
10 dark. 

Figure 45B is a diagram showing luminance, of each region shown in Figure 45A. 

Figure .46 is a block diagram showing an automatic exposure control apparatus of Example 9 according 
to the present invention. 

Figure 47 is an image frame divided into an upper region, a right region, a left' region,' and a lower 
16 central region. . 

Figure 48 is an. image frame divided ipto an upper region, a right region, a left regidn, and a lower 
central region. ... 

Figure 49 is a graph showing . an spectral distribution of an optical 'source having a color" temperature in ■ 
the range of '3000 K to 1.0000 K. . . ' , . . _ ' " ; - — 

20 Figure 50 is a graph . showing the relationship/between the anribuht of infrared rays and the color 

temperature. . . - . . , ; . . , - : . . , . , 

Figure 51 is a graph showing the conversion from the difference pi of an averag^ luminance' between 
the first and second regions or the difference p2 of an average luminance between the third and forih - 
regions into the correction amount calculatiori gain* g..^ ' - ' ".'^ 

25 Figure 52 is a block diagram showing an autorriatic exjDosure control apparatus of Example 10 
according to the present invention. , ^ - - ; , / > 

Figure 53 is a block -diagram showing an automatic exposure bontml, apparatus -of Example 11 
according to the present invention- , , . ./ h ' * ' - . - ^ ' 

Figure 54 is a graph, showing the, Sjensitiylty pl^.threje p • ' ^ - - - ■ . 

30 Figure 55 is block diagram showing an automatic exposure control apparatus of Example 12' according 
to the present invention. . ' ' ' - ' ' ■ 

Figure 56 is a graph showing the relationship between the color difference and the color temperature. • ■ 

Figure, 57 is a block diagram showing an autpnri'atic exposure cpntrol apparatus of Examples 13 to 15 
according to the present invention. .. .. ' - . ^ - 

35 Figure 58 . is a block diagram stiowing an automatic exposure control apparatus pf Example 16 

according to the present invention. - V . . 

Figure 59 is an image frame divided into upper. and lower regions. " 

Figure 60 is a graph illustrating the judgment between the backlight and the excessive frontlight. based' 
on the luminance difference. : - , " . ' . 

40 Figure 61 is a luminance order characteristic curve, " 

Figure 62 is a block diagram showing a conventional automatic exposure control apparatus. 

Figure 63 is a block diagram showing a .conventional autpnnatic exposure control apparatus. 

Figure 64 is an image frame divided into a two regions for illustrating' the conventional automatic 
exposure control apparatus. 

45 Figure 65 is an image frame divided into three regions '^for illustrating the conventional automatic 

exposure control apparatus. 

DESCRIPTION OF THE PREFERRED ENBODIMENTS 

50 Hereinafter, the present invention will be described by-way. of illustrating examples with reference to the 

drawings. - . ^ ...^ ... 

* ■ - ,. ^ " ' ' 

Examples ^. ' ' ' 5 - . - - - ■ 

55 Example 1 

Figure 1 shows, an example of an autom^tic, exposure control apparatus according to the present 
invention. An image of an object is formed on a pickup element 3 through a lens i' and a diaphragm '2, and' 
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is converted into an electric signal. The signal is annplified by ah amplifier 4. Then, the signal subjected 
to a y treatment while passing through a signal processing circuit 5 and Is transmitted to a video s.gnal 
output tern^inal 6, At this time. a . diaphragm control is performed based on the signal obtained from the 

pickup element 3 as follows: w „ , ^„ ■.rr.^r,^ 

An image frame luminance average calculation unit 7 calculates an average luminance Yall of an image 
frame based on the signal from the pickup element 3. A diaphragm control unit 8 compares the average 
luminance Yall with a target luminance value Yair obtained by a target luminance calculation unit 9 and - 
controls the diaphragm opening or closing. so that the difference between the average luminance Yal and- 
the target luminance Yalf is made 0. whereby the average iCiminance Yall is kept s"bst^"^'^"y/^"!'' *° 
target luminance Yall'. For example, when a dynamic range of the pickup element 3 is 0 to 255 (B-Dit - 
information), the target luminance Yair is set at 127 (central value) in an ordinary exposure . 

An image frame is divided into a plurality of small regions. For example, the image frarrie 13 ,s divided- 
into 100 small regions 14 (10 divisions in a vertical direction and 10 divisions in a horizontal direction) as in 
Figure 2. The average luminance of a small region is represented by an average luminance of pixels 
included in the small region. Thus, the apparent number of pixels (the number of small regions) is 1 00. 

A small region luminance average calculation unit 10 calculates the average luminance for each small 
region based, on the signal from:thepicl<up. element 3. .. . .=,t,=,ii rcnir..-. 

Next a low luminance average calculation unit 11 arranges an average luminance of each small region 
in a luminance order as shown, in Figure 3. This is. called a luminance order characteristic. In ^'9^--^ 3. 
vertical axis represents luminance and a horiz'ontal axis represents the numbenng of each small region 
(pixel , number), arranged in. order of low luminance. Thus, the luminance shows a nnonotone increase 
chsrsctsristic ■ 

An average value' of 'tow luminance regions (i.e., an aveVage lijminance in certain pixelranges; e.g., 
pixel number 1 to tsl).a.s shown. in Figure 3 is a parapeter- representing the degree of backlight. The^ 
25 principle of this will be described. ., „ 

When very^ bright regions are present in an image frame, the aperture opening is made small in order to 
make an ^average luminance 127.' As k result. Mn r&dions' other -than the very bright regions, luminance 
becomes very low. and the image frame is divi.ded into bright regions and dark regions. The case in which 
an object is present in the dark regions under this cohditipn cprresporids to a backlight state. ngures^4A 
30 through 4F a?e examples ^ showing the degree of backligfit. In the respective figures. ■ a shaded portion- 
corresponds to a dark region. In Figure 4A. a region with a luminance of 0 occupies half of an image frame, 
and the remaining region has a luminance of 255,. Thus, an average luminance .b^^^^^^s ^27^ A lur^inanee 
order characteristic is as shovvn in Figure 4D. Figure 4B shows an image under a weak backlight state, in 
which a quarter..of an image frame is dark. An average value of low luminance regions (an average 
luminance of regions whose pixel numbers are 1 to 30) is larger than that of Figure 4A. In Figure 4A, an 
average value of low luminance regions is 0. Figure. 4C shows an image in a fronllight state.' An^average 
value of low luminance regions in. Figure 4F is larger'than that of Figure 4E. Thus, the degree :of .backlight 
which a human being feels can be represented by an average value' of low luminance [^g.ons More 
specifically as an average value of low luminance regions is smaller, higher degree of backlight is obtained 
An average value of low luminance regions is obtairied by calculatirig an average value trorri the lowest 
luminance (luminance at the 'ist pixel) to luminance at the Nth pixel, using the following Formula (1). Here, 
the numbering of pixels' is arranged in the order of the lowest luminance to the highest luminance. 
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n . : - • . 

V - IV(1)/N ... (1) 

1-1 ; - . . 



50 where V is an average value of low luminance regions, vfi) Is a luminance-|evel at the ith pixel, and N is a 

^'"^A^bTcWight degree calculation unit 12 calculates the degree of backlight by applying a gairi to the 
average value of low luminance regions V, using the following Formula (2). 

55 u = k • (cl - V) (2) - - ~ ' 

where L = .0 in the case' of cl - V < 0; u' is' the degree of babklightrk ig a gain; and'cl Is a constant value: 
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The target luminance calculation unit 9 sets a target value of an average luminance of an image frame 
for each vertical scanning (frarhe or field), based on the degree of backlight u obtained by the backlight 
degree calculation unit 12. Specifically, the target luminance calculation unit 9 calculates the target 
luminance Yall' by the following Formula (3). 

5 

Yair = Yinit*(l + u) (3) ; - . _ - . ^ ' 

where Yinit is an initial target luminance. 

The diaphragm control unit 8 regulates the diaphragm so that the average luminance Yall is kept at the 
70 target luminance Yair. When the average value ofjow luminance regions is small, u has a value of 0 or 
more and the target luminance YalP becomes high. 'As a result, the diaphragm is opened so that the person 
can become easy to observe a region having toc^Tow luminance to be observed. 

As described above, according to the present example, the degree of backlight is determined based on 
an average value of low luminance regions, whereby a stable backlight correction suitable for a human 
75 being's feeling can be performed. 

Example 2 



Figure 5 is a second example of an automatic exposure control apparatus according to the present 
20 invention. ThQ same reference numerals as those of Exampfe 1 are marked 'for the sarhe components as 
those of Example 1. The same components as those of Example 1 function in the same way as in Example^ 
1. The difference between Example 1 and Example '2 is iri that-a ioW luminance average calculati^^ unit 15 
and a backlight degree calculation unit 16 are prdvided in Exarhplis 2 instead of the low luminance average- 
calculation unit 11 and the backlight degree calculatibh unit i2 in Example 1. " ' ' *' ' 
25 Jhe function of the low luminance average calculation unit 15 wilt be described with reference to Figure ■ " 

The low luminance average calculation unit 15 caiculates a plurality of overage values of low luniiriarice ' 
regions in the same way as the low luminance^ as/erage calculation unit ll of Example 1. Average values in ' 
ranges (a) and (b) are ei and e2. respectively. The degree of backlight is obtained by -using the average 
30 values Oi and Cs. Thus, an average luminance of dark regions can be made a characteristic amount for 
calculating the degree of backlight by using a plurality of average values of low luminance regions. More ^ 
specifically, when both of the average values ei and 82 are low, an exposure control for strong backlight is 
performed; and only when the average value ei is low, an exposure control for weak backlight is performed: ' 

Next, a nnethod for obtaining the degree of backlight,' based on the average values ei andjB2, by using 
35 fuzzy inference will be described. Assuming that inputs are *ei and 62, and the degree of backlight'is u. a 
control ruie of simplified fuzzy inference Is represented, for example, as followsr ' ^ ^ ^ . 

If e- is PB and 02 is NS, then u is fi. 
where positive big (PB) and negative small (NS) are fuzzy variables; and fj is a real number. 

When input data {e^ \ 02') is input, the following conclusion is obtained from the abovemeritioned rule. 

Ui(fi), = .UPB(er) •UNs(e2')A1 (4) ' ' , ' ■ ' ' • 

where A is min operation. 

- Since there are .a plurality of control rules, the final degree of backlight' Ur obtained by' integrating the 
45 results of the Formula (4) is as follows: ' ^ . 

Ichibashi et al. have already reported that the above-nnentloned simplified fuzzy inference becomes a 
linear . multiple function . (Ichtbashi et al., "Learning CohtroVby Fuz^y Models Using a Simplified Fuzzy ^ 
65 Reasoning", Nippon; fuzzy society report, Vol. 2^ No. 3; pp. 429-437). A method of inference based on the 
liiiear, multiple function is suitable fpr a real time' control duis to it's low cpsl bf calculation. ^ ^ " 

„. According to the linear nriultiple function, the deigree of 'backlight is obtained 'by' 'inserting' the real ■ 
number fj. Figure 7 shows four, points on an inpuf space (e^. W) and a real number for each point. Hererthe^ 
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real number f, is represented by f(Xp, y,). The inference result u, is obtained by using a real number for four 
points, employing the Formula (5) as follows: .. , . 

If «p s ^1 < *p+i' yq ^ ®2 < yq+1' 

then, Uj. = X * y * f(Xp+j^. Yq+l^ 

+ * y * £(xp, yq+i) (6) 

^ + X * (;i-y) * f(Xp+i, Vq) : :^ 

■h (1-x) * (1-y) * f(Xp, yq) , 

where . -• . 



X = (ei - Xp)/(Xp+i - Xp) • . 

y = (62 - yq)/(yq+i - Vq) 

As Shown in Figure 8. 'a linear.multiple function can. lie formed by connecting the space inserted by the 
20 four points. m.^ntiooed above. The. degree .of backlight u, suitable, fpr various Images can be obtained as a 
non^Hnear amount by .successiy.ely detertpining a real. number . f(Xp. y,) from an image under a backhght 
state Figure 9, shows an example in, which, the degree of, backlight, is represented. by the linear multiple 
function. When both of e, and ej bepome low values, the, i^legree of backlight is increased in a non-linear 

25 "^^^The target luminance calculation unit 9 sets a target value of an average liiminance of an image.'frame 
for each .vertical, scannina (frame. or field), based, pn the,. deg.ree of.backlight u, obtained by the ^backlight 
degree Galculation unit.. 16. Specifically; the ..target': luiriin?^ calculates theMarget 

luminanc^,YalHy lf?e folloyying Formula {7) in the ^^^ , . 

30 Yair- t;. Yinit^(l .+,u,)._' '(7) ... . ^ . ... .V, .y • . : ' .. ■ • ■■ . 

where YinitJs an initial target luminance. . , 

As described above, according to the present example, a plurality of average, values of low lunninance 
■ ■ . • .• i . I 1 iL-ir-i I-,;. tk» f...^-... inf<&f-c>nr^e> nr the linear multiole 



35 



regions are obtained, and degrees of backlight are integrated by the fuzzy inference or the linear multiple 
function, whereby a stable backlight correction suitable f.or a human ^eing's feeling can be perfomned. 



Examples ' ; •. 

Figure 10 is a third example of an automatic exposure control apparatus according- to the present 
40 invention. The same reference numerals as those of Example 1 are marked for the same components as 
those of Example 1 . The same components as those of Example 1 function in the same way as in Example 

^ The image frame luminance average, calculation unit 7 calculates an average luminance Yall of .aii • 
image frame, based on the signal from the pickup element 3. The diaphragm control unit 8 compares the 
45 average luminance Yall with a target luminance Yair obtained by the target luminance calculation unit 9, and 
controls the diaphragm to be opened or closed so that the difference between the average luminance Yall 
and the target luminance Yair is made 0, whereby, the average luminance Yall is kept substantially equal to 
the target luminance Yall'. For example, in the case where a dynamic range of the pickup element 3 is 0 to 
255 (8-bit information), the target luminance Yall" Ts set at 1?7 (central ' value) in the ordinary exposure 

50 control. ' • • c <-ia 

An image frame is divided into an upper region and a lower region as shown in Figure HA. An 
upper/lower regions luminance average conriparispn^.Mnit. 17 palculates .an average luminance of the upper 
and lower regions of the image frame, based pp a signal from, the pickup element 3. . 
,The image frame. lis also divi;decl intp a.plu'rality .'of^.snnail .regiohs. For example, the image frame is 
55 divided into 80 small regions (S.divisions in a vertical -direclion .arid 10 divisions in a horizontal- direction) as 
shown>in Figure 11B. A small region luminance- average calculation unit 18 calculates an average luminance 
of each small region' of the. image frame, jhe; luiriinance. of a 'sm.alf region is represented by an average 
luminance of pixels included in the small region. Thus, the apparent' number of pixels is 80. 
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The degree of backlight is obtained in the same way as in Example 2. A low luminance average 
calculation unit 19 arranges each average luminance of each small region in the order of low luminance as 
shown in Figure 6, and calculates an average value of low luminance regions. Next, a backlight degree 
calculating unit 20 calculates a backlight degree Ur' by fuzzy inference or a linear multiple' function. 
5 The degree of excessive frontlight is obtained by using a luminance order characteristic. As shown in 

Figure 12 and the following Formula (8), a high luminance average calculation unit 21 calculates an average 
value from the Mth pixel to the highest luminance. ' 

80 , v. 
10 .... "V 

e3 = rv(i)/(80 - M) ... (8) 

i-M ' /. '■ "■. - 

75 where Ss is an average value of high luminance regions, v{i) is a luminance level of the ith pixel from the 
lowest luminance 'level, and M is a pixel number. 

An excessive' frontlight degree calculation unit 22 calculates' an excessive frontlight degree w^ by 
converting ea by the use of a linear multiple function and the like. 

A degree determination unit -23 determines a final correction amount, based on the backli^tit degree Ur ' 

20 and the excessive frontlight degree w^. The ^degree determination ^unit 23 judges whether- the image IFrame is 
in a -backlight^'state or in' an excessive frontlight state, based on^ a luminance diffeTrence' between' the upper 
region and the lower region of an image franrie.' SpecifieaHy; the degree determination unit 23 calculates the 
luminance difference by the= following- Formula (9)", and convertis the luminance difference into a real" value g 
within an interval [-1, 1]. Figure 13 shows a conversion diagram from the luminance difference to the real 

25 value* g:^' ^- ' - ' • ^. a ■ c.:. .■ ' 

Lunninance difference - (Average luhn i nance of upper ire g ion) - (Average luminance oflower region) -(9) 

A correction amount z is obtained' by the following Formula (10). • ' ■'■ ■ - 

If g S 0, then 2 =- Wr * g • ^ " ' ■ ' * ■ . , - r ^ 

If g > 0, then 2 = Ur " g (10) - . . j- ; . 

When a camera direction or luminance of an image frame are greatly changed, the luminance 
35 difference between the upper and lower regions is changed. Therefore, even though the luminance 
difference between the upper and lower regions is changed; an image which' is hardly seeri cannot be 
obtained. Thus, the luminance difference betvveen the' upper and- lower regions can be used to' judge 
whether the image frame is in a backlight state or in an excessive frontlight state. "' " . ' • 

The-target luminance calculation unit 9 sets a target value of ah average lOmihance'of an'image frame 
for each vertical scanning (frame or field), baserf on the correctioh amount z obtained by the degree 
determination unit 23. Specifically, the target luminance 'calculation unit 9 calculates the target luminance 
Yali' by the following Formula (11). 
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45 



Yair = Yinit " (1 + 2) (11) 



where Yinit is'an initial target lirminance? , " ' : 

•The diaphragm control unit 8 regulates a diaphragm so that the average luminance Yall is- kept at the 

aboVe-me'ntioned target lunninance Yal!''.- When the upper region of an image frame is brighter than the 

low^er region thereof, the image frame is judged to be in a backlight state. Then.'a correction is made based 
50 on the degree of backlight. In contrast, when the upper region is darker than the lower region, the image 

frame is judged' to be in ah excessive frontlight state: Then, a correction is made baised on the degree of 

excessive frontlight. ^ ' ^ " , ■ 

As described above, according to the present example, the degree of backlight is obtained based on 'an 

average value of low luminance regions and the' degree of excessive frontlight is obtained based on an 
55 average value of high luminance regions.' Each 'degree is selectively regulated in accordance with results 

obtained by comparing the average' luririi nance- bf thb uppei-'region with that of the lower region, whbreby a 

stable correction suitatpl^ for a human beirig*s feeling can be performed. ' ' ^ 
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In the present example, the judgment whether it is in a backlight state or in a excessive frontlight state 
is made based on the luminance difference. It is apparent that the same effects can be obtained even if the 
ratio between the average luminance of the upper region and the average luminance of the lower region is • 
used instead of the luminance difference. , . : • 

Example 4 

Figure 14 shows a forth example of an automatic exposure control apparatus according to the present 
invention- The reference numerals of Example 4 are marked for the same components as those of Example 

70 3. The same components as those;, of Example 4 function in the same way as in Example 3. The difference 
between Examples 3 and 4 is in the functions of the high luminance average calculation unit 21 and the 
excessive frontlight degree calculation unit 22. In the present example,' a low luminance average calculation 
unit 24 and an excessive frontlight degree calculation unit 25 are provided instead of the high luminance 
average calculation unit 21 and the.excessive frontlight degree. calculation unit 22 ^- - „ : 

15 In the case where there are a great number of low luminance regions in an innage frame, there are; a 

few high luminance regions in the image frame. Accordingly, suchj an situation rnay be. considered to be. in 
an excessive frontlight state. The excessive frontlight- degree is obtained ,in the same way as -in.. the. 
backlight degree. The low luminance average calculation , unit 19 arranges respective average luminances of 
each small -region - in the . increasing order, of .the JoW:- luminance as , shown in Figure 6, and calculates ,an 

20 average value of low- lurniriance regions. Then, an e.xces^ive, frontlight degree calculation ur|it.25 calculates 
the, degree of^.excessive -frontlight by the use of fuzzy inference or a linear multiple function. The degree 
determination unit 23 determines a final correction. ar;nourit jD^sed on the backlight degree and the excessive 
frontlight.degree. . . - r, , ; v -r . : . , , =. - - 

As described above, according to the present example, the degrees of backlight and excessive 

25 frontlight are obtained based on an average value of low luminance regions. Bach degree is selectively 
regulated in acGorda,nce. with. results obtained by.cpmia^ririg the average luminance of the upper region with 
that of the lower region, whereby a stable correction suitable for a human being's feeling can be performed. 

In the present example, the judgment as. to y/hether it is^ in a backlight. state or in a,: excessive frontjight 
state is made based on the luminance difference. It is apparent that the same effects can be obtained even 

30 if the ratio between the average luminance of the upper region and the average luminance of the lower 
region is used instead of the luminance difference. 

Exannple 5 ... ; . - ; -. 

35 Hereinafter, a fifth .example of the present invention will be described. The present example has an 
additional objective of preventLng a rhisjudgment with respect- to an excessive frontlight image wherq an 
object moves up and down. , ^ . • ^. 

As shown in Figures 15A.and 15B, there- ha^s beep a problem in that the misjudgment^mentionecl- above 
causes the saturation of., the luminance of the object, resulting in forming a white inr^age of the object. 

40 Figures 15A and 15B show excessive frontlight. images where an object moves up and down; and Figure 
15C shows chariges of an average luminance 141 of an upper region 71 and an average luminance 142 of a. 
lower region 72 when the object moves up and down. Here, the position of the object is represented by a 
head top 31 thereof. r . v . - 

When the object stays at the position D, the average luminance 141 is lower than the average 

45 luminance 142, as shown in Figure 15C. Therefore, the judgement that the image.frame-is in an.excessive. 
frontlight state is made. This is a correct judgement. However, when the object moves from the position- D 
to.the position T, the average luminarice,.141 .becomes higher than the average-lunninance'142. This is. the 
reason why the misjudgement .occurs.. To avoid such a misjudgement, improvements will be described-, 
below. . . . . . , , ... . . ' .. . ' ' ... ' 

50 Figure 16 is a fifth example of an autonnatic exposure- control, apparatus according to the present 
invention. The same reference numerals as those of the presvious examples are marked for the same 
components as those of. the.- preceding, ones. The same .components as those of thO:, preceding, exam pies 
function in the sanne way as those of the preceding example . , , . , ^ . . . , , . 

. .,An image of an object is forrned.on the pickup.,elenherit 3 through the lens 1,. and the diaphragm. 2,,. and 

55 is converted to an, electnc signal. Jhe signal is amplified .by the.ampjifier 4. Then, the signal. is subjected to. 
a 7 treatment while passing through the signal processing ^circuit 5 ^nd. is .transmitted to the video sigrial. 
output terminal 6. At this time, a diaphragm control is performed based on the signal obtained from the 
pickup element 3 as follows: 
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An image frame luminance average calculation unit 7 calculates an average luminance of an image 
frame, based on the signal from the pickup element 3. The diaphragm control unit 8 compares the average 
luminance with a target luminance obtained by the target luminance calculation unit 9, and controls the 
diaphragm to be opened 'or closed so that the difference between the average luminance and the target 
5 luminance is made 0, whereby the average luminance is kept substantially equal to the target luminance. 

A small region luminance average calculation unit 10 calculates an average luminance in each of a 
plurality of small regions based on the signal from the pickup element 3 so as to obtain a luminance order 
characteristic of the luminance levels. t 

The degree calculation unit 27 calculates an average value of low luminance regions from the 
70 luminance order characteristic. The average luminance of low lurhihahce regions is converted into, a non- 
linear manner by fuzzy inference or the like, whereby a backlight degree u^ representing the degree of 
backlight of a pickup image is calculated. In addition, an average luminance of high luminance regions is 
calculated from the luminance order charactehstic, and the Average luminance is converted in a non-linear 
mariner by fuzzy inference, whereby ah excessive'^frontlight degree Wr is calculated. ' 
75 The image frame is divided into a lower central region 210, an upper region 220, a left region 230, and 

right region 240 as shown in Figure 17." 

Now, we introduce the following definitions: . - ^ 
(1) A region X is one of the left region 230 and the righf region 240, which has a lower' average 
luminance- than the other.-. ^- . . . - . 

20 (2) A region Y is one of the' left region 230 and the right region 240, ' which has a higher- average 
luminance than the other. ^■ ' - - - • r ; : = ^ . 

(3) A first region is a combination of the region X With the upper region 220. '■ ' 

(4) A second region is a cdmbihatidn-of the reigion Y with the lower central region 210." 

A first/second regions luminance average comparison unit 26 calculates an average luminance of each 
25 region, and a difference p between an average lurriinande 'of the second region and an average luminance- 
of the first region. The degrees of backlight and excessive 'frdntligh't. and "the difference p are transrriitted to^ 
a correction amount calculation unit 28. " ^ ■ - - - - - - • , . ^ ^ - ^ . 

The correction amount calculation unit 28 judges the ihnage frame to be in a backlight state in the case 
where the average luminance of the first region is higher than that of the second region, and judges the 
30 image frame to be in an excessive frontlight state in the case where the average luminance of the first* 
region is lower than that of the second region; These judgments are based oh the tendency that an image" 
frame is likely to be in a backlight state when an upper region of the image frame is brighter than the lower 
region thereof, and that the ihnage frame is likely to be in an excessive frontlight state otherwise: In addition; 
the correction amount calculation unit 28 converts the luminance difference p into a gain g used for 
35 calculating the correction amount z as shown ih Figure 13. A correction amount z is calculated by the 
following Formula (12), based on the backlight degree u^, the excessive frontlight degree w^, the gain g and 
the result of the judgment between the backlight and the excessi>>e frontlight. ' 

If p ^ 0, then excessive frontlight, z = g * w^ 
40 If p > 0, then backlight, z = g * Ur (12) 

The relationship between the respective average luminances of the first and second regions obtained 
by the first/second regions luminance average comparison unit 26 and the movement of an object will be 
described in detail with t-eference to Figures 18A to 18C, 19A to 19C and 20A to 2dD. 

45 Figures 18A and 18B show excessive frontlight images in the case where ah object moves up and 
down; and Figure 18C shows changes of an average luminance 32 of the first region and of an average 
luminance 33 of the second region. Mere, the pbsition of'the object is represented by the head top 311 
thereof. As shown in Figure 18C, the average luminance 32 of the first region does not exceed the average 
luminance 33 of the second region, while the object moves from a central position D to a top end position 

50 T. Thus, a misjudgment is not made with respect to the excessive frontlight image where ah object moves 
up and down, so that neither the gain g nor the correction amount' z do' not change. 

Hereinafter, a correction amount z with respect to a backlight image' in which an object moves from side 
to side; and a cdrrectiori amount z with respect: to^ a backlight image In whifch an object is present on the 
right side of ah image frame and a dark' substance 'gets in' and but of the left side thereof will be described. 

55 Figures 19A and 19B ishow backlight irhages where ah object Vioves from side to side; and Figure 19C'- 

shows^changes of an* average luminance 32 of the ^first region^ and ah average luminance 33 of the second 
region while the object moves from a right position R to a 'left positioh' L. As shown in' Figure 19Cr while 'the - 
object moves from the right position R to the left position L, the average luminance 33 of the second regiofi 
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y . . , ^ 

does not exceed the average luminance 32 of the first region. 

Figures 20A arid 20B show backlight images where an object is present on the right side of an image 
frame and .a dark substance gets in and out of the I.eft side thereof; and Figure 20.C shows changes of an 
average luminance 32 of the first region and an average luminance 33 of the second region. Here, the 

5 posilion of the substance is represented by a right end 51 thereof. As shown in Figure 20C, while the 
substance mpv.es from the left end of the image frame to the boundary L of the left region 230 and -the 
lower central region 210, an average luminance 33 of the second region does not exceed an average 
luminance, 32 of the first region. 

Thus, a misjudgment is not made. with- respect to a backlight innage where an object moves from side to 

70 side and with respect to a backlight image where an object is present on the right side of the image .frame 
and a dark substance gets in and out of the left side thereof. Therefore, :f or the same, reasons as described 
above, neither the gain g nor the correction amount z change.. . 

Figure 20D shows changes of the average luminance 32;Of the first. region .and the average luminance. 
33 of the s^ecpnd region, with respect to, a backlight ipnage .where an object is present on the right side of 

75 the image frame and a dark substance gets in and out of the left side thereof. In this case, an image frame 
is divided so that the sum of the vertical length of the right region and tbat.pf the, upper region and the sum 
of the vertical length of the left region and that of the upper -region .respectively coincide with the, vertical 
length of the image frame. As shown in Figure 20D, while the substance moves fronn the left end -of the 
image .frame -, tp; the boundary L of ■ the left region,. 230 = and . the lower • central - region 210, the average 

20 luminance 32 of the first region exceeds the average luminance 33 of the second region. . Thus, a 
misjudgment is made. However, when the image frame is divided: so that the.rsum-of the vertical length of 
the right region and that of the^upger region and the :sum of the vertical length /of) the. left region and that of 
the upper region are respectively made sgn.aller ;than the vertical length of the image frame, a misjudgment 
as described above is npt r;T;iade. , Therefore,. it is required; that. th.e inr^age -frann^ isodivided so that theiSum of- 

25 the vertical Jeagth of the right and that of the upper re^giop. and .th^, sum., of the^Jef^ regi and that^pf.the 
upper region are respectively made smaller than the vertical length of the/jtnriage^fonne. . - . ' - 

The target ..iuminancQrcalcuiation unit 9 sets a target value of; gn average lunninance o.f an image frame 
for^each y.ertical scarining, b,y adding the correction amount:; z obtained by^4he correction amount calculation 
unit 28 to a predeternnined target luminance. The diaphragrri . cqatrol- unit Z, regulates a diaphragrn so that 

30 the. average, luminance of the image frame is kept subigtant [ally- equal to .the target value. 

As described above, an appropriate exposure of an pbje.ct for . a. backlight innage where an object moves 
from side to. side and a backlight image, where, a dark; substance getS;.in and put of one side. of the image 
frame is obtained.. . .i • 

In the present example, the judgnrient whether it is in a backlight state or in a excessive frontlight state 

35 is made based- on the luminance difference. It is apparent that the- same effects can be obtairied even if the 
. ratio between the average luminance of the uppei; region and the average luminance of the lower region is 
used instead of the luminance difference. 

Example 6 . *: ' ■ ■ 

40 

A sixth example of an automatic exposure control, apparatus according to the present invention will be 
described with reference, to Figure 21. The same reference numerals as those of Example 5 are nnarked.for 
the same components as those of. Example, -5. The sanrre eonnponents as thpse of Example S.function in the 
same way as in,Exannple 5. - m • : *. . " 

45 . An image of an object is formed on the pickup/element 3. through the lens 1 and the'diaphragm 2,- and 
is converted to an electric signal. The signal is amplified by the amplifier 4.. Then, the signal is subjected to 
a 7 treatment while passing through. the signal prpcessmg circuit 5 and is transmitted- to the video signal 
output terminal 6. At this time, a diaphragm control, is performed based on Jthe signal obtained. frorji the. 
pickup element 3 as follows: , ... , .... ■ 

50 An image frame luminance average calculation unit 7, calculates an average luminance of an image 
frame, based on the signal from the pickup. elemept.-3. The diaphragm control unit 8 compares the average 
luminance with a target luminance value, o.btained,;by .the target luminance^ calculation unit 9, and. controls 
the diaphragm to be opened or closed so that the, difference between the average lunr;ti nance- arid the target, 
luminance is-made 0, whereby the average. luminancejs kept substantially. equal to the targetjummance. • 

55 .A smaii region luminance average calculation, unit vIO calculates an^ average, luminance in each of a 
plur;ality of small regions based on the- signal from. the pickup element 3,so as to obtain a luminance order, 
characteristic. of the luminance levels. ... ■ • •. ' -= • 
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The degree calculation unit 27 calculates an average value of low luminance regions from the 
luminance order characteristic. The average luminance of low luminance regions is converted in a non-linear 
manner by fuzzy inference or the like, whereby a backlight degree Ur representing the degree of backlight 
of a pickup image is calculated. In addition, an average luminance of high luminance regions is calculated 
5 from the luminance order characteristic, and the average luminance is converted in a non-linear manner by 
' fuzzy "inference, whereby an excessive' frontlight degree Wr is calculated. 

An image frame is divided into a lower central region 210, an upper region 220. a left region 230, and a 
right region 240 as shown in Figure 17. ' ' „ 

Now, we introduce the following definitions: 
10 (1) A region X is one of the left region 230 and the right region 240, which has a iowefr average 
luminance than the other. ,\ 

(2) A region V is one of the left region 230 and 'the right region 240, which has a higher average" 
lurriinance than the other. ' ' 

(3) A first region is a combination of the region ^ with the upper region 220. 

75 (4) A second region is a combination of the' region Y with the lower cehti-al region 210, ' 

The first/second regions luminance average comparison unit '26 calculates an average luminance of 
each region and a lunninance ratio jDi of an average luminance of tlhe second region to that of the first 
region. ' \ . ' ' . . • i . - . , 

A first judgment unit 61 judges whether the image frame is in a backlight state' or in an excessive 
20 frontlight state, based on the "lurriinance ratio pi ' obtained ' by the first/sdcond regions luminance average 
comparison calculation unit 26 in the same way as in Example' 5. A judgment value ji is determined by the 
following For.mula (13):' \ ! ' ' - : - - r ... ;i \ . 

If pi^ 1 , then excessive frontlight, ji = 0 ^ ' ' ' • * ^ ■ , 

25 If Pi > l/thWn backlight Ji = 1 '(13) / " . c. - ■ : . . ^ . ,: 

where the judgment values are either 0 or 1; the judgment value 0 refers to excessive frontlight, and the" 
judgnrient value 1 refers to; babklight' \ ' ' ' ' ''''^ ' ' 

A second judgment unit 62 divides an image fraiWer into an upper regiiDh 71 and a iower region 72' as^^ 
shown in' Figure 22, and. cialcufates an average I urtiinance ratio P2 therebetween. The second judgment unit 
62 judges an image frame to be in 'a backlight' state in the case where an average luminance of the upper 
region 71 is hjgher than that of the lower region 72; and judges the image frame to be in an excessive 
frontlight state in the case where an average |urnmahce of the upper region, 71 is lower than that of the 
lower region 72, A judgment value j2 is calculated by the follovv *^ ' . 

If P2 ^ l. then excessive frontlight, j2 =0 
If P2 > 1 , then backlight, j2 = 1 (14) 

A correction amount calculation unit 63 calculates a cprrei^tion amount Zi , based on the backlight 
degree u^, the excessive frontlight degree Wr, the" judgment value ji, and the judgment value j2 by the 
following F^ormula (15). ^ " ■ - ' 

Ifii/j2 = O; then' exceissive frontlight, 2i = -1 * w^ 

If ji * j2 = i. backlight, 2i = Ur (15) / ' ' 

As is understood the Formula (15), when either one of the judgment values ji or jz is 0, it is judged to 
be in ,an excessive frontlight state; arid when both of the judgment values ji and j2 are 1, it is judged to be 
in a backlight state. *^ ■ . 

The relationship between the movement of the object and the respective average luminances of the first 
and second regions, and the upper and lower regions will be described with reference to Figures 23A to 
23C,' 24a tp 24C,, 25A to' 25C, and 26A to 26C. As described above, the respective 'average luminances of 
the first and second regions are obtained by the first/second regions luririi nance "kverage comparison unit 26; 
and the respective ' average luminances of the up^er and lower regions are* obtained by the second 
judgment unit 62. ^ ' . . 

Figures 23A and 23B show excessive frontlight images where an object moves up and down; and 
Figure 23C shows changes of an average luminance 32 of the first region, an average luminance 33 of the 
second /eg ion, an aye rage luminance 61 of the upper region, and an average luminance 82 of the lower 
region, while the object moves from' a central position D to a top end position T. Here, the position of the 
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object is represented by a head top 31 thereof. As shown in Figure 23C, while the object nnoves fronn the 
central. position D to the top end position T. the average luminance 32 of the first region does not exceed 
the -average luminance 33 of the second region. Therefore, a misjudgment is not made and a correction 
amount zi, does not change. ^ 
6 Hereinafter, a correction amount zi with respect to a backlight image where an object moves from side 

to side; a correction amount 2i with respect to a backlight image , where an object is present on the. right 
side of an image frame and a dark substance gets in and out of the left side thereof; a correction amount z^ 
with respect to a backlight image where an object is present on the right side of the image frarrie and a 
bright substance gets in and out of the right side thereof will be described. 
10 Figures 24A and 24B show backlight images in the case where an object moves from side to side; and 
Figure 24C shows changes of an average luminance 32 of the. first region, an average luminance 33 of. the 
second region, an average luminance 81 of the' upper regiori,'*and an average luminance 82 of the lower 
region, while the object moves from a right position R to a left position L Here, the position of the object is 
represented by a head top 31 thereof/ As shown in Figure 24C.. while the object moves from the right 
15 position R to the left position U, the average luminance . 32 of the first region and the average luminance 33 
of the second region do not change. Therefore, the correction amount zi does not change. . ^ 

Figures 25A and 25B show backlight images in the case where an object' is present on the right side of 
an image frame and a , dark substance gets" in. and out . of the left side thereof: and Figure 25C ^shows 
changes of an average luminance 32 of the Jirst regiori..ah averag^^ the second region, an 

20 average juminance 81 of the upper region, and an /average J um'i nance 82 of the lower region, Here, the , 
position of the substance is represeiited by a right end 51 ' thereof. As shown in Figure 25C,^ while the. ^ 
substance moves from the left end of the image frame to the boundary L of the left region 230 and the 
lower central region 210. the average luminance 33 of the second region does not exceed the average 
luminance 32 of the first region; and the average luminance 82 of the lower region does' not exceed the 
25 average luminance 81 of the upper region. Therefore, a misjudgment is not made, and the correction 
amOjUnt zj does not^c hang e,.. . ...... , ....^ ■■ : . . 

"Figures 26A and 26B show excessive frontlight images in the case where ah object is present on the , 
right side.^of .the image frame, and^.a bright substance gets. in and put of the left side thereof; and Figure 26C^^ 
shows" changes of/an average lurniri'ance 32 of the firs] ..region,' a.n average. I urrii nance 33 of the second 
30 regiori, an average luminance 81 ^of the upper .region, and >n , average luminance'82 of the lower region/ 
Here, .the position of the substance is represented .by a . right end 121 thereof,' .As shown; in Figure 26C. < 
while the .substance rpoves from the ieft end of the imaLge.,frame to the boundary L of the left region 230 
and the lower central Won 21 o; the average lurpinanbe. 81 of the upper region does not. exceed thei 
average luminance 82 of the lower region. Thus, a misjudgment is not made, and the correction amount zi 
35 does not change. - ' , 

As described above, for the same reasons as described with reference to Figures 25A to 25C. a 
misjudgment is not made with respect to a. backlight image where an object moves from side to side, a 
backlight image where .an object is, present on the right side of the inriage .frame arid a dark substance gets 
in and out of the left side thereof, and an excessive froritlight image where .an object Is present on; the ri^ht 
40 side of the image frarrie arid a bright" substance gets in and out of the left side thereof. Thus, the correction 
amount zi does not change. 

The target luminance calculation unit 9 sets a target value of an average luminance of an image frame 
for each vertical scanning (frame or field), by adding the correction amount z^ obtained by the correction 
amount calculation unit 63 to a predetermined target luminance. The diaphragm control unit 8 regulates a 
45 diaphragm. so that the average lunninance.of the image frame is kept substantially equal to the target value. 

As' described above, an appropriate exposure of an. object for an excessive frontljght image; where Jhe 
object moves'up and down, a backlight image where the object moves from side to side, a backlight inrtage 
where a dark substance gets in and put of one side of the image frame, and a backlight irn age where a 
bright substance. gets in and out of both sides oflhe image frame can be obtained., .... 

50 In the present example, the judgnrient is made as to whether it is in a backlight state or in an excessive, 
frontl'ight state is based; on' the luminance .ratio. .It' is apparent that the same effects cari, be 9btarned even if. 
the difference between/the average luminance of the upper region and the average luminance of the lower* 
region' is used instead of the luminance' ratio. ^ _ 

55 Ex~ampie^,7 ' .... -f j ' ' ' I.' . i . • , - *..*'"* 

A seventh example of the present invention wiU be described. The present 'exannple overcomes the' 
foilowirig problem; An excessive frontlight' image where' a' central 'region of an image franne is bright and a 
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lower region thereof is dark is misjudged to be in a backlight state and the luminance ot a main object is 
saturated so as to become white. This phenomenon is often caused in the case where an outdoor scene is 
taken from an indoor side. 

Figure 27A shows an excessive frontlight image where a central region of an image frame is bright and 
5 the remaining region thereof is dark; and Figure 27B shows an average luminance of a lower central region 
210, an upper region 220, a left region 230. a right region 240, a first region and a second region, obtained 
by dividing the image frame as shown in Figure 28. Here, the first region corresponds to a combination of 
the left or right region which has a higher luminance and the , upper region; and the second region 
corresponds to a combine^tion of the left or right region which has a lower luminance and the lower region. 

10 As is understood from Figure 276, since the average luminance of the first region is higher than that of 

the second region, the image frame is misjudged to be in a backlight state. 

The present example is one embodiment for overcoming this problem. Its objective is to provide an 
automatic, exposure control apparatus which does not misjudge an excessive frontlight image where a 
central, region of an image frame is bright arid the remaining region thereof is dark/ln addition, the 

75 apparatus aisp .does, not misjudge a backlight image where ^an object' moves from side to side and an 
excessive frontlight image where an object moves up and down.' 

Figure 29, shows a seventh example of an automatic exposure control apparatus according to the 
present invention: The same reference numerals as those of the preceding examples are marked for the 
same components as those of the preceding exarhples. The same components as those of the preceding 

20 exaryiples function in the same way as in the^ preceding exarnp^^^ ' i - 

An image of an object is formed on the pickup element 3 through the lens f and" the diaphragm 2, and 
IS converted to an electric signal. The' signal is amplified' by* the amplifier 4. Then, the signal is subjected to 
a y treatment white passing through the signal processing circuit 5 and is transnSitted to the video signal 
output terminal 6. At this time, a diaphragm control is conducted based on the signal obtained from the 

25 pickup element 3 as follows: ' " ' ' ■ ' - •'■ 

An image frame lurninanpe average calculation unit 7 calculates an averag*^ luminance 'of an image' 
frame., based on the signal, ifrom the pickup elemem 3: The diapKragm'' control linit 8 comib'ares the average 
luminance with a target luminance obtained by tfie :tBrget: luminance^ ca^^^^^^^ unit s:' and cohtrots the' 
diaphragm to be opened or closed so that the av'eV^ge lurtiinanbe is^ kepr^^^^^ the target 

30 luminance. . 

A small region luminance average calculation^ uriit iO calculates an average luminance in each of a 
plurality of small regions based on the signal from \he pickup element 3 so as to obtain a luminance order 
characteristic of the luminance levels. ' ^ ' . - ^ 

the degree calculation unit 27 calculates an average value of low luminance regions from the lumiriance 
35 order characteristic. The average luminance of , low luminance regions is converted in a non-linear manner 
by fuzzy inference or the. like, v^hereby a backlight degree u^ representing the degree of backlight of a 
pickup image is calculated. In addition, an average luminance of high luminance regions is calculated from 
the lumtnance order characteristic, and the average luminance is converted in a non-linear manner by fuzzy 
inference, .whereby an excessive frontlight degree Wr is calculated. " ' ' 
40 An image frame is divided into the lowe^r central region 210. the upper region 220, the left region 230 
and the right region 240 as shown in Figure 2&. 

Now, we Introduce the following definitions: . 
(I )- A region X is ope of the left region 230 and the right region 240. which has a lower average 
luminance than the other. : 

45 (2) A region Y is one of the left , region 230 and the right region 240, which has a higher average 
lunninance than the other, , . 

(3X A first region is a.combination of. the region Y with the upper region 220. 
(4). A second region is, a conribination of the region X with the lower central region 210. " 
. The first/second regiSns luminance average comparison unit 26 calculates an average luminance of 
50 each region and a difference p of an average luminance between the* first region and the second region. 

.;A correlation, value calculation unit 29 calculates a. correlation value E. based on an average luminarice 
Sij and a predetermined luminance, distributiori % of an excessive frontlight image where a predetermined 
central jegion is. bright. using the following; Formula (16), Here; the Sjj represents an average luminance of 
each. small region qf the image frame, which is' normalized with an average luminance of the image' frame ' 
66 The Vj^ represents a predetermined luminance of each* small region 6f the irr^age^ frame. The i and j of "the 
Vij and Vij represent a position of a small region in the image frame as shown in Figure 30. 
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E - EECS^j - V^j)^ ... (16) 
Ij . 

The normalization of an average luminance of each small region performed' by the correlation value ' 
calculation unit 29 and the predetermined luminance distribution will be described in detail with reference to 
Figures 31A, 31B. 32A, 32B, 33, 34Aand 34B. . ,. , , ■ 

Figures 31A and 318 show an average luminance of each small region and an average luminance of an 
image frame in a case where a bright object positioned at a central region of the Image frame ,s m an 
excessive frontlight state,. but the bright object, is. taken with different diaphragm values. The .mage frame 

'"'''"The'fr^agTfrlmerof ' Figures 31 A and 31B are in the same' excessive, frontlight state. Accordingly. ' 
these image frames should have.the.same correlation values. However, if the correlation values correspond- 
i inq to the image frames of Figures 31 A and 31 B were calculated, based on average luminances of small 
regions. -the calculated correlation values would all. be different from, each other. Th.s '^ ^f cause j 
predetermined luminance distribution, used for calculating the correlation value .s fixed and av^l^S^. . 
luminance of each, small region of the image fra.me of Figure 31 A is different from that of Figure 31B when 
the object is taken with differed diaphragm values: In order to make the^avera^e 
, region of.the.image frame of Figure 31.A .equal ,to thaj of Fig.ure 31B.when the object is taken with d.fferen 
diaphragm values, the.aver^ge luminance of ..each small region is nornn^lized with an average luminance of 

the image frame, which wiji.'be described, below. . .. „ ,.■ r.- • • _ . - „„ith ' 

Yhe average lurpinances of ...each .small region of; Figure 31.A and that of Figure 31B are connpared with 
an average luminance of-an if^age frame. When^an average luminance of a small region is larger than the 
5 average luminance of the irnage frame, the average. luminance of the small region is made 1 : 'vhen an 
average luminance..of a smal.l.regidn is. s-Vialler tha.n,Jhe ^veragie luminance of the ^mage frame, the average 
luminance of.'.the small region is made to. be 0. The resuits. are shown in Figures 32A and; 32B. respectively. 
AsTis understood, fro^n Figures -MA: and 32B. the replacement of. the average luminance of «ach^^"^aj 
region into two values (either 0' or 1 f by using the average luminarice of the image frame as a threshoW 
,0 vie causes the .same luminance distribution, even, though the object is taken with different diaphragm 

f^ioure 33' shows a predetermined luminance distribution of ah excessive frontlight image where a 
predetermined central regiori is bright, The reason why a.vertical length of the P'-^^^*®;'^'"^^ J"";'"^"*;^, 
distribution is.made smaller' thari that of a.n image. trame is to distinguish an excessive frontlight image of 
35 Figure 34A from another excessive frontlight image of Figure 348. . u .liitw'Af 

It is' apparent that We same effects as those of the above; can be obtained even though a plurality of 
values are used for no.rrtial'izirig an average value of each" small region' instead of .two values, using a 
luminance 'ratio and a luminance difference. _ ■■ ^-^ ■ h th«:> ^«rroiatinn 

The degrees of backlight and excessive froptlight,; the ^verage luminance difference, and the correlation 
40 value "E are transmitted tolhe correction amount calculation unit 28. . ' . ^ ,h- oi..<;' 

The correction amount calculation unit 28 compares the correlation value E with a threshold value 
When the correlation value E is smaller than the threshold value the image frame is judged to be in an 
excessive frontlight state! where a central region is bright, and the correction amount z is made the 
excessive frontlight degree w. When the correlation value .E is larger than the threshbid value the 
.5 following judgments are made using the average luminance difference p: In the case where an average 
luminance of the first region is higher than that of the second region, the image frame is judged to be in a 
backlight state, and in the case where an average, luminance of the first region is lower than that of ttie 
second region, the image frame is judged to be in an excessive frontlight state. These judgments are mad^e, 
taking advantage of the tendency' where, backlight is' obtained when the upper region of the .mage frame is 
50 brighter than the lower region ..thereof, and excessive frontlight is pbtained when the upper region of the- 
image frame is darker than the lower region thereof. In addition, the 'correction amount calculation unit 28 
converts the luminance di.fference p into a gain g used 'for calculating the correction amount as ^'^l 
FiQure 13 Then " the correction amount z is calculated by. the following Formula (17), based on" the tjackhght 
degree' u',; 'the excessive frontlighf degree' vvn"ttiegain_g, arid ttife' results of the judgment between the 
b5 backlight and the (excessive frontlight. " _ ^ . , . • . 

If E i f , then excessive frontlight, 2 = w^ 

If E > € & p ^ 0, then excessive frontlight, z = g ' w, 
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If E > c & p > 0, then backlight, z = g * (17) 

Hereinafter, the relationship between the mpvennent of an object and the respective average luminances 
of the first and second regions obtained by a first/second regions luminance average comparison unit 26 
5 will be described in detail with reference to Figures 35A to 35D and 36A to 36D. 

Figures 35A and 35B show excessive frontiight images in the case where an object moves up and 
down; Figure 35C shows a change of a correlation value 92 while the object moves from the central position 
D of the image frame to the top end position T thereof; and Figure 35D shows changes of an average 
luminance 83 of the first . region and an average luminance 84 of the second region while the object moves 
70 from the central position 6 to the top end position T. Here, the position of the object is represented by the 
head top 91 thereof. . ' 

As shown in Figure 35C, while the object moves from the central position D to the top end position T, 
the correlation value 92 becomes smaller than the threshold value e. When the correlation value 92 is equal 
to or less than . the threshold value c, the image frame is judged to be in an excessive frontiight state, 
75 causing no problems. However, a problem arises when the correlation value 92 is larger than the threshold 
value e. - . - : . 

As shown in Figure 35D, In the case where the correlation value 92 is larger than the threshold value e, 
while the object moves from the central position D to the top, end position T, the average luminance 83 of 
the first region is smaller than the average .luminance 84 of the second region at all tirhes, so'that the image 
20 frame is judged, to be in an excessive frontiight State, m^ . 

As described above, a misjudgment is not made with reject to the excesTsive frontiight" image where 
the object moves up and down,, Thu?.. neither the gain g nor the correction amount z change. ' " 

Hereinafter, the correction amount z with respect to a backlight image wher^ the object" moves frorti 
side to side will be described. - - - . : ^ • ' 

25 Figures 36A and 36B show backlight images where an . pbject rhbves frorh side to side: Figure 36C 
shows a change of a correlation value 92 while the object nri'oves from the right 'position R to the left position 
L; and Figure 36D. shows changes.of an_ average luminance 93t.of the first. region and an averadie luminance 
94 of the second region, while object moves from the "right position ' R to the left position L. Hbre, the 
position of the object is represented by a head top 91, thereof. • ' * • ' 

30 As shown in Figure 36C, while the. object movies from the rfghl position R to the left position L, the 
correlation value E,is larger than the threshold value c at all. times, so that the image frame Is judged to be 
in a backlight or an excessive frontiight, based on an average luminan^ the first and 

second regions., . '/ ... ^ . . 

As shown in Figure 36D,. while th^ object move^ from the right position R to the left position L. the 
35 average luminance 93 of the first region is larger than the average luminance 94 of the second region at all 
times,, so that the image frame isjudged to be in a backlight state; making rid misjudg.merits. 

As described above, no misjudgments are nnade with respect, to a' backlight ' image where an object 
moves fronn side to side.r Thus, neither the gain g nor the correction amount z change: ' " 

The target luminance calculation unit 9 sets a target value of an average luminance of an image frame 
40 for each vertical, scanning (frame or field), by adding the correction amount z obtained by the correction 
amount calculation unit 28 to a predetermined target luminance. The diaphragm controi'unit 8 regulates a 
diaphragm so that the average luminance of the image frame is kept substantially equal to the target value. ' 

As described above, an appropriate exposure of an object for an excessive frontiight innage where the 
central region of the image frame is bright and the remaining region thereof is dark, an excessive frontiight 
45 image, where^an object moves up and down, and a backlight image where an object moves from side to 
side can be obtained. . . ' : : " 

It. is apparent: that the same effects can be obtained 'even though the, comparison of the lurninances by' 
the :-first/second regions luminance average, comparison unit' 26 is performed by using a lurriinance ratio 
instead of a luminance difference. ; . / / . . . - 

Example 8 . .. . - . . ' • 

• The present example also overcomes the fpliowing'^problenn;; An excessive frontiight image where- a 
central-region of. an image fra.me is bright and a lower region thereof is dark is hnisjudged to be in a' 
65 backlight, state and Jhe luminance of a main' object^s saturated to becpm'e^ White. ^ Thii phenomehon'is often 
caused jn the case where an outdoor scene is taken. from ian indoor site J ' * ' 

;, -Figure 37 shows an eighth example an .automatic' exposu apparatus according to' the'' 

-present invention. The same reference numerals as those .of. the preceding examples are rnarked for trife ■ 
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same components as those of the preceding examples. The same components as those of the preceding 
pyamnles function in the same way as in the preceding examples. 

Tn !mlgB oran Object is formed on the pickup element 3 through the lens 1 ar.d the ^-aphragm 2 and 
is converted to an elecU signal. The signal is amplified by the amplifier 4. 

a y treatment while passing through the.signal processing circu.l 5 and .s ^^^"^'"'"^^ "'f ° "^^^^^^^ 
ouIpLrt terminal. 6. At this time, a diaphragm control is performed based on the signal obta,ned from the. 

'''^Zl:S^^:i—s.er^so.c...o. unit 7 calou.tes an 

frame based on the signal from", the pickup elemerit 3. The diaphragm control unit B compares the average 
, m'nance w^^^^ a target luminance obtained by the target luminance calculation --^J; J ^^^^^^^ 
diaohraqm to be opened or closed so that the difference between the average luminance and the target 
f minLncT i made 0. whereby the -average lumir^ance is kept substantially equal to the '-9;^ J"-'--- . 

A small reoion luminance average calculation unit 10 calculates an average luminance of each of a 
plura^itr^ s3 regiTrba,ed on%^ .ignal from the picJ^up element 3 so as to a luminance order 
5 characteristic of tlie luminance levels. inminance' • 

The degree calculation unit 27 calculates an average value of low lum.nance /^^a^^^VTn l^iarT^^^^^^^ 
order characteristic. The.average luminance of low' lumihance regions - f "r^'H '"ee rSgTo" 
bv fuzzv inference or the like, whereby a backlight degree u, representing' the degree of backlight ot a 
pfckrimagns calculated. In addition, an average luminahce'bf. high luminance regions is calculated f om 
0 'he lumrance orSer characteristic, and the .average luminance is converted in a non-linear manner by fuzzy 
inference' whereby an excessive f'rbntlight degree w, is calculated. • - «on =„h =. - 

InTmag^ral is divided into a lower central region 2 liD; an uppdr region 220.; a left region 230. and a • 

right region 240 as shown in Figure 38. ... 

'Now we introduce, the following. definitions: ^ . . - . ^ ■ , ow^ran^j^ 

,s (fi AlSion X is .one of the , left region .'^30 ..ind:;the, right regic^n 24(r. which has a lower averagej 

S^r:3o!?V^ of th^ left'region 2^^.^^^.^^^ which- h.s ,a ^ higher averagei . 

luminance than the other. ... .. 

(3> A first region is a combination of the region Y With the upper region zzo. / 

(A) A second region is a combination of the region k With' the lower central region 21 0. . / . ' ^ ^, • 
'l^t fSsecond regions luminance average comparison- unit '26 calculates an^;average luminance of, 
each region and a difference p of an average luminance between the first and second ^eg.ons^ _ ^ _ 
Moreover, a comparison result correction unit 30 divides the image frame mto a <=«7;':^'°", .^^^^ 
= Jrinh',=r«i rpnion 3932 as showh in Figure 39 and calc-ulates an average luminance of each region, based- 
3S ^nTsS rthf pickup rment I A difference .q of '^ average luminance between the --age frame 
and tL Sa Uegion 3931 (i.e.. an average lu-f.inance of the central region 3931 - an average luminance of 
'he ir^aqe f^rn^rcaLlated the drffererfce q of an average luminance is converted into a correction - 
ar^ount A Ircor^ec^rng a -difference , p of an average luminance between the first and second regions as 

''T corScrd'c^fference p' of an average l.r^inande is caVbuiated using the difference p of ah average ' 
luminance and the correction aiinount A by the following Formula (18). , „ • 

p- = p.- A (18) . ., . , ' ' , . . 

" The degrees of backlight and excessive frontlight.-and the corrected difference p' of - an average 
luminance are .transmitted to the correction amount calculation unit 28. ^^..^n^, '^tate in the case 

■ The correction amount calculation unit 28 judges the image frame to be in a ^^^ck '9^ J^te in the^ca^^^ 
Where a value obtained by subtracting the correction amount A from the -^If^J^^J^^^l ^.^.^^ 
reqion is larger than the average luminance of the second region, and ludges the .mage frame to ^e an 
excessive f^ontlight state in the case where a value obtained by subtracting the 

^he average lumfnance of the first region is smaller than the average luminance of the second ;«9'0" J 
udgrnts a eTased on the tendency that, an image. frame is likely to be In a backlight ^^^^^^^ 
uppTreglon of the image frame is brighter than the lower' region thereof and that t^-.'^t^f ^^^^^^^f^^ 
to be in an. excessive frontlight state when other wise.jh addition, the correction amount calc^^ 
converts ihe corrected ' average lulhiharite differefice' p" into a gam g used for calculating a correction 
amount z as shown in Figure 41. TheTi. a correction ' amount z is calculated by the following Formula (IS). 
Son;t4 bSght^degree u,. the ex^e.^iVe frontl.ght.^de^ree w^. the g.in g". and the' result of judgment 
between the backlight and the excessive frohtlight. 



40 



45 



50 



21 



aNSDOCiD- <EP__.0570968A2 I > 



EP 0 570 968 A2 



If p' S 0, then excessive frontlight, 2 = g * Wr . , 

If p' > 0, then backlight, z = g * Ur (19) . . - 

5 The average luminancg of the central region of an excessive frontlight image where the central region of 

an innage frame is bright and. the lower region thereof is dark, obtained by the comparison result correction 
unit 30; the average lunninance of the image frame, the correction anhount, and the respective average 
luminance of the first and second regions obtained by the first/second regions luminance average 
comparison unit 26 will be described with reference to Figures 42A and 42B. 

70 Figure 42A shows an excessive frontlight inriage where the central region of the image frame is bright 
and the remaining region thereof is dark; and Figure 42B shows the average luminance of the central region 
of the ..image frame in Figure 42A, the average luminarice of the Image frame, the correction amount A, the 
average luminance of the first and second regions, and the value obtained by subtracting the correction 
amount A from the average luminance of the first region. ^ 

75 As is understood from Figure, 42B, the value obtained by subtracting the correction amount A from the 
average luminance of the first region is smaller than the average luminance of the second region." Because 
of this,; no misjudgments are made with re?pect.to the. excessive frontlight image where the central region is 
bright and. the lower region- is dark. Thus^nether gain'g nor the, correction amount 2 change. ' ^- ' 

Next, the relationship between the movement of ah object, the average luminance of the central region, 

20 the average luminance of Xhp image irame, .and the correction amount; arid those among the movemerit of 
an object, the average luminances of the first and second regions and the corrected average luminance 6f 
the first region will be described in .detail with reference to Figures 43A to 430,' and i4A to 44D1 

Figures 43A and 438 show excessive front|ight Images .where, an object moves up 'and do Wh; Figure ^ 
43C shows changes of . an average luminance, 172'.,pf the central region of an 'image 'franne, ah average - 

25 luminance -73 of the image frame, and. a correction arnount 74; and Fjgure 43d shows changed of ah 

average luminance 75 of the first region, an average, lunninance 76 of the second region, and a corrected 

average luminance 77 of the irirst region. Here^.the 'position .of the" object is represented 'by' a head top 91 
thereof. - - - . , ^ ^ . . . ... . ^ ^. . . 

As shown in Figure- 42fD, .while an object. moves frpm the central position D of the imag^ frame^to the^ 
30 top end position T thereqf.-.the corrected.average jumj nance, 77 the first region is lower thah the average 
luminance 76; of the second region at all. times,, sp that the image frame is judged to be Ih an excessive 
frontlight state. Thus,> no misjudgments are made,with respect to the exce.ssive frontlight image the 
object moves up and dovj/n; as a result, neither gain g,npr the correction anriount 2 change. ' 
Figures 44A and 448 show backlight images in the case where an object moves from side to side; 
35 Figure 44C shows changes pf an average luminance. 182 of the central region, an average luminance 183 of 
an image frame, and a correction amount 184; and Figure 44D shows an' average (uminahce 85 of the" first 
region, an average luminance 86 of the second region, and a corrected average luminance 87 of the first 
region. Here, the position of the object is represented, by., a head top 91 thereof 

As shown in Figure 4.4D, while the object moves, from the right position R of . the image frame to the left 
40 position L thereof, the ; corrected, average .luminance .87 of . the first region is. higher than the average 
luminance 86 of the second regipn at all .times. s,o the innage frarne ' is judged to be in a backlight state. 
Thus, no misjudgments are made with respect , to „a backlight image, where an object moves from side to 
side; as a result, neither gain g nor the correction, amount z change. 

The target luminance ca^culation unit 9 sets a target value of .an average luminance of an image frame 
45 for each vertical scanning (frame or field), by adding the correction amount 2 obtained by the correction 
amount calculation unit 28 to a predetermined target luminance. The diaphragm control unit 8 regulates a 
diaphragm so that the. average luminance of the image frame is kept substantially equal to the target value. 

As described above, an appropriate exposure of an object for an excessive frontlight image where the 
central region of the innage frame is bright and theJower region .thereof is dark, an excessive frontlight 
50 image where an object moves up and down, and a backlight image where an object moves from side to 
side can be obtained. 

Example.:9 • ■ - ; r; . , ■ . . . ■ . " . ; c , . ^. / ■ 

66 r> A: ninth exarnple,,of the, present invention. wi[l be. ^described/ f h^ example overcorhes the 

lollowing problem; When -an ^ object is irradiated with a a wed.dihg 'piarty), an 

^.excessive frontlight image where the right hallpf ^n image .frame is, bright and the 'left half thereof isjdark is 
misjudged to be in a backlight state. As a result, the luminance of the object is saturated 'so a^ tb become 
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Figure 45A shows an excessive frontlight image where a right half of an .mage frame .s bright and he 
left hi thereof is darK; and Figure 45B shows an average lurr^inance of f "^^^'"f^^^^^^^^^^^ 
the image frame shown in Figure 45A into an upper region, a lower central reg.on, a nght region and a left 

a Sion as "own in Figure 3? and an average luminance of the respective first ar.d -cond-g.ons. Hare 
thS first, region.corresponds to a combination of either one of the right or left reg.ons -^'^^ ^ '^fj^ 
luminance and.the upper region; and the second region corresponds to a combmafon of either one of the 
right or left regions which has a lower luminance and the lower region. ■ 

As is understood from Figure 45B. the average luminance of the first reg.on is higher than that of the 

,0 second region, so that the image frame is nr)isjudged to be in a backlight^state. excessive • 

If the Tmage frame with a luminance di^nbutibn as shown m Figure 45A is judged to be in a" ^^^^^^'^^ 
frontlight state, this problem can be oVorcome: However, butdbbrs, the bright region of .^--^^J.^;;;^"^ 
Figure 45A corresponds to a substance with a high luminance such as. the sun; as a result, the .mage frame . 
becomes a backlight state. Thus, a misjudgment is made. ■■ \ ;c 'nmx/ide an 

,5 The present example overcomes the above-rnentionM , problem and .ts^o^^^^^^^ 
automatic exposure control apparatus which does not make T^^'^^f'-^;^,-^^^^^^^^ 
frontlight image where .indpors:.the right half, of an image-frame -s bright ^^^^^^^ ^^"3 

does not. make, a misjudgment with respect to a backlighf , image where outdoors, the nght half of an .mage^ 
frame is brinht and the left half thereof is dark./ ^. . *u .^^r.«t 

,0 ^iguS46 Shows a ninth example of an autbrnaticjexpbsure control 'apparatus according to th^ Present- 
invenl'n. the ^ .r^es^^^^r^rri^ai^^yi^..^ the preceding examples are for the sam 

components as those., of Jhe -pr^dirig Vxarrjples. The; g^^^^^ as those of the preceding 

examoles function in the same way as in the precedrng; examples ... ^ o 

An Sage 7an obilat-i^,^^^^^^^ Ripkub elembnr S'thVough the lens .1 and the ".aphragm 2 _arg • 

.5 is converte^d' to an e.eplric signa,.^,he .signaris arhplified by me amplifier 4. Then. -9"^^'^, ^^^^^^^^^ 
a ^.treatment" while passing'thrbugh the signal f.rbces§ind\circXiit 5' and is transmitted to the ^'deo s^gna^ 
ou^puftoSl i Afthistk;^'adiaphr^^^ signal obtamed from the - 

'^^'^iSf^-U^ShcS^er^eca^^^^^ 
30 frami based on the signal from the pickup element.a/The -diaphragm control unit 8 cornpares the average 
" Snance with a target luminance obtained t,y the; targenuminance calculation -fj; f ^ -^J^^J*; 
diaphragm to be opened or closed, so, that. the difference between the average "7"^;^^/"^ ^ 
luminance is. made. to 'be .0. whereby thp , average Wnriinahce is kept substantially equal to the target 

luminance . ^^^^^^ calculation unit- iff calculates an average J."/^^^"f °2 

plurality of small re^ibns. based on the signal from; the pickup element 3 so as to obtain a luminance order 

characteristic of the luminance levels. '.' ' ' ,' , , .. „v,.,o fr«m thP lumihance 

The degree calculation unit 27 calculates an average value of low luminance regions from lummance 
order characteristic, the average luminance of low luminance ^regions- is -"-^^'S.'a^eVo back^^^^^^^ 
40 by fuzzy "inference ' or the like, whereby a backlight ^degree u,; representing the 'degree- of bact^naM of a 
pfckup image is calculateb.' In addition, an average luminance of high luminance reg.ons l^^^f^^ ^'^'^ ; 
the luminance order characteristic, and the average luminance is;converted m a non-l.near manner by fuzzy 
inference, whereby an excessive frontlight degree w,- is calculated. „o« , « .^i^n ^-^n ;,nrt-a 

■ An image fram^ is divided, into a lower central region 210. ah upper region 220, a left region 230. and a 

45 right region 240 as. shown in Figure 47: ; , , " . 

Now, we introduce the following definitions: " . w,- ^ h« =, lower Av/Praae 

(1) A. region X is one ofMh'e left region 230 and the right region • 240. which has a- lower average 

iunriinance than the other. . ' . . , . , hi^hor av/pranp 

(2) A region Y is one of the left region 230 and the right region 240, which has a higher average 

50 luminance than the Other. 

(3) A first region is a combination of the region Y with the upper region 220. 

(4) A second region is a combination of the region X with the lower central region 210. 

The first/second regions luminance average comparison unit 26 calculates an average '""^'";^9^ 
each region and a difference p, of an average luminance between the first region and ^J.^^J^ r^^^^^^^ 

'The image fra^ne is also' divided into a lower'central region 310, an upper region 320. a left region 330. 
a right rediort 340. as shown in Figure 48.' rvlow.' we introduce the following definitions:- ■ • • ^ 

pi A, region fc. is one of thb left. region 330 and thd right region 340..which has av lower average 

luminance than the other. 
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(2') A region Y' is one of the left region 330 and the right region 340, which has a higher average 
luminance than the other. 

(3') A third region is a combination of the region X' with the upper region 320. 
(4*) A fourth region is a combination of the region Y* with the lower central region 310. 
5 A third/fourth regions luminance average comparison unit 315 calculates an average luminance of each 

region and a difference P2 of an average luminance between the third and forth regions. 

The infrared rays amount detection unit 140 detects infrared rays from a light source/and converts the 
detected infrared rays Into an electric signal q in proportion to the amount of the detected infrared rays: Ah 
indoor/outdoor judgment unit 155 compares the electric signal q with a predeterrriined threshold value and 
10 converts the electric signal q into a control signal r by the following Formula (20). 

\f q S €\ then the indoors r = 0 . ■ - : 

If q >€, then the outdoors r = 1 (20)' - - " ' - . 

w The principle of the judgment between the indoors and the outdoors by using the amount of infrared 

rays will be described. 

It js known that a color temperature of an indoor light source is different fi-orti that of an outdoor light 
source, the "color temperature of an indoor light'soijrce such as 'a fluorescent light is generally in the range 
of 3000 to 3500 K; and the color temperature of an outdoor light source such as the sun is 3500 K or more: 

20 Figure. 49 shows a spectral distribLition in the case' where the color temperature of an light -source 

changes from 3000 K to 10000 K. Infrared rays have' a wavelength longer than the wavelength- represented^ 
by a broken line in Figure 49; and the amount of infrared rays corresponds to an area which is~^ situated to 
the right side of the broken line. Figure 50 shows the'relationship between the color temperature and the 
amount of infrared rays. As is understood fr6m\-Fi5ure 50/ the'* judgment between the indoors and the 

25 outdoors is made possible by setting a threshold y^^ ' - ' - 

The difference pi in ari average luminance, the difference p2. in an average luminance; arid the control 
signal r, and the degrees of backlight and excessive frontlight are transmitted to the ' correction' amount 
calculation unit 28. ' • • • ^ .i,-:-. ,v 

The correction amount calculation unit 28 selects the difference' pi outdoors and selects the difference' 

30 p2 indoors.^ according to the control signal r. Tjiese selections are based on the tendency that an image 
frame having a bright right half and a 'dark left half is likely to be in an excessive frontlight state ihdoors'and 
the same image frame is likely to be. in a backlight state outdoors. 

Moreover, the correction amount calculation unit 28 judges dn image frame to be in a backlight state 
when the first or third region containing the upper regibri has an average luminance higher than that of the 

35 second or forth region containing the lower center region;' and judges" an image franne to be in an excessive 
frontlight state when the first or third region has an average luminance lower than that of the second or forth ' 
region. These judgments are based on the tendency that it is likeiyjo be in a backlight state when the 
upper region is brighter than the lower region, arid it is likely to be ih an excessive frontlight state when the 
uppei- region is darker than the lower region. Moreover, the correction amount calculation unit 28 converts 

40 the difference pi or the difference p2 into a gain g used for calculating a correction amount as shown in 
Figure 51. Then, a correction amount z is calculated by the following Formula' (21), based on the backlight 
degree Ur, the excessive frontlight degree w^. the gain ^g, and the result of the judgment between the 
backlight and the excessive frontlight. 

45 If Pi or- p2 g 0/then excessive frontlight. z '= g * Wr ^. . : . - 

If Pi or p2 > .0, then backlight, 2 = g * Ur (21) ' 

The targetjuminance calculation unit 9 sets' a target value' of an average lurrimance of'an image frame" 
for each vertical scanning (frame or field), by adding the' correction amount 2 obtained by the correction ' 
50 amount calculation unit 28 to a predetermined target luminance. The diaphragm control unit 8 regulates a 
diaphragm so that the average luminance of the image frame is kept substantially equal to the target value. 

As described above, an appropriate exposure of an object for an excessive frontlight image where the 
central region of the image frame is bright^and the lower region thereof is dark, an excessive frontlight 
imag^ where an object moves up and down, and a backlight image where an object moves from side to 
56 side can be obtained. ' ' ' ' ' ''' ' ' ■ ' ^ ' " ■■ • - 
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Example 10 

Figure 52 is a tenth .example ot an automatic exposure control apparatus according to the present 
invention. The present example overconnes the same problem as in Example 9. , 

5 An image of an object is formed on the pickup element 3 through the lens 1 and the diaphragm 2, and 

is converted to an electric signal. The signal is amplified by the amplifier 4. Then, the signal is subjected to 
a 7 treatment while passing through the signal processing circuit 5 and is transmitted to^the video signal ^ 
output, terminal 6. At this time, a diaphragm, control is performed based on the signal obtained from the 
pickup element 3 as follows: . - 

10 An image frame luminance average calculation unit 7 calculates an average luminance of an image 
frame based on the signal from the pickup element 3. The diaphragm control unit 8 connpares the average 
luminance with a target luminance value obtained by the target luminance calculation unit 9. and controls . 
the diaphragm to be opened or closed so that the difference between the average luminance and the target 
luminance is made to be 0, whereby .the average luminance is kept substantially equal to the target 

75 luminance. . : . ' , 

A small region luminance average calculation unit 10 calculates an average luminance in each oj a 
plurality of .small regions based, on the signal from the ^pickup, element 3 so. as to obtain a luminance order 
characteristic of the luminance, levels. , . , v — . ■ . .. . 

The degree calculation unit 27 calculates an average'value.of low luminarice regions from the luminance, 
20 order characteristic. The average luminance of loyy luminance, regions is converted in a non-linear manner 
by fuzzy inference or' the like, whereby a backlight degree -u, representing the degree of backlight of a 
pickup image is' calculated- In addition, an average I urrii nance of high luminance regions is calculated from 
the luminance order characteristic, and the average lurinipance is converted In a non:Iin^ar manrier by fuzzy 
inference, whereby an excessive fronttight degree Wr is" calculated. 
25 An,image- frame is divided into th^ lovy^r ceritral.region^'aiO. the upper, region 220. the left region .230. 
and the right.retgion,240 as shown'in Figur^ 47.\ . , -.-^-.o . , - ,^ ■ - , , - . ^ 

Now, we introduce the following definitions: 

m A. region KJs one of the left region 23^ and the, rigljt , region 240,. which has a lower average 
luminance than the. other. ■ - • -• ■ ^. . 

30 (2) A region -Yiis.one.of, the /left region 230, and.; t^^^^ region 240, yvhich has a higher average 

luminance than the other. • - , 

(3) . A first region. is a combinatipip of the region Y with .the. upper region 220. . 

(4) A second region is a combination of the region X' with the lower, central region 210. 

The first/second regions luminance average cbmparispn unit 26 calculates, ari average luminance of 
35 each region, and a difference pi of an average luminance between the first region and the second '^QP^- 

The image frame is also divided into a lower central region 310, an upper region 320, a Jeft region. 330. 
a right region 340', .as shown in Figure 48. Now,'vye introduce the following, definitions: , 

(V) A, region. X' is one of the .left region 330 and .the right region 340. which has a lovyer^ average 
luminance than the other. . ^ ■ - , ' ' 

40 (2') A region V is one of the left region 330 ar^d the right region 340, which has a higher average 
luminance than the. other. , . . - , - , . - ^ - : ^ 

(3') A third region is a combination of the region X* with the upper region 320. , — 

(4') A fourth region is a combination of the region Y' with the lower central region ^310. 
A third/fourth regions luminance average comparison unit 315 calculates an average luminance of each 
45 region and a difference P2 of an average luminance between the third and forth regions. . . ^ ' 

The indoor/outdoor judgment unit 34 calculates a control signal r by using the following Formula (22), 
based on the average luminance Yall of the image frame obtained by the image frame luminance average 
calculation -unit 7 and a! diaphragm value F 6btained.by the^ diaphragm control unit 8. where p. is a 
predetermined threshold value. ^ . . . 

50 . _ .. . , . • - r . 

If Yall/F S 7 , then small amount of light ='the indoors r = 0 . ,^ . < . . 

If Yall/F > 7 , then large amount of light = the outdoors / = 1 (22y , ^ . ^ . , - 

The principle of the judgment between the indoors'ahd the outdoors by'usirigi the average luminance. 
65 Yall and the diaphragm value F will be described. . r * 

The amount of light from an outdoor light source such as the sun is larger than the amount of light from 
an indoor light source such as a fluorescent light. Thus, the judgment between the indoors and the outdoors 
is made based on the amount of light which is inferred from the average luminance Yall and the diaphragm 
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value F. 

The relationship between an optical annount O, the diaphragnri value F, and the average luminance Yall 
is represented as follows: 

5 O = Yall/F (23) ' 

Therefore, the judgment between the. indoors and the outdoors Is made possible by setting a threshold 
value 7. ' 

The difference pi of an average- luminance, the difference p2 of an average luminance, the 'control 
10 signal r, and the degrees of backlight and excessive frontlight. are transmitted to the correction amount 
calculation unit 28. 

The correction amount calculation unit 28 selects the difference pi outdoors and selects the difference 
P2 indoors, according to, the control. signal r. These selections are, based on the tendency that an image 
frame having a bright right half and a dark left half is likely to be in an, excessive frontlight state indoors' and 
15 the same image frame is likely to be in a backlight, state outdoors. ' ' 

Moreover, the correction amount calculation unit 28 judges an image frame to be in a backlight state 
when the first or third region containing the upper, region, has an average luminance higher than that of the 
second or forth region containing the lower central region; and judges an image frame to be in ah excessive 
frontlight state when the first or third region has an ^average luminapce lower .than that of the seciphd or forth' 
20 region. These judgments, are based, on. the tendency that it. is likely to be in a backlight state when the 
upper region is brighter than the lower region, :and t^iat itjs likely to be in an excessive frontlight state wh^n' 
the upper region is darker than the lower region- ,,Morepver, , the correction amount calculation unit 28 
converts the difference pi or; the difference p2 into, a, gain g. used for calc'ulatirig a correbtion ainnount as 
shown in Figure 51. Then, a correction amount 2- is. calculated by the Formula (21), based on the backlight 
25 degree Ur, the excessive frontlight degree w^, tha gain g, , and the/ ^^^^^ pf the judgment between the - 
backlight and the excessive frontlight. / ' . ' - • ' v: ; 

The target lunninance calculation unit 9 sets a. largest value. of an average iuryiinance of an irnage frame ' 
for each vertical scanning (frame or field), by adding the correction amount 2. obtained by the cdrrection 
amount calculation unit; 28 to a predetermined targ^tj luminance.. The diaphragm contror unit '8 regulates a* 
30 diaphragm so that the average luminarice of the image franne is kept substantially' equal to the target value.' 

As^described above, an appropriate exposure, of, an object for an excessive frontlight imaae wh4re the 
central region of the image frame is bright and the lower region thereof is dark, an excessive frontlight 
image where an object moves up and down, and a backlight image. where an object moves from side to 
side can be obtained. , , , . - . . 

Example 11 ' , ' / " ^ . 

An eleventh example will be described. The present exann pie overcomes the same, problem as that of 
Example 10. Figure 53 shows an eleventh example of an automatic exposure control apparatus according to 
40 the present .invention. . , \ [ 

;An image, of an, object is formed on the pickup element 3 thrpugh the, lens 1 and the diaphragm 2, and 
is converted to an electric signal. The signal is amplified by the amplifier 4. Then, the signal is subjected to 
a 7 treatment, while passing through the signal processing circuit 5 and is transmitted to the video sigrial 
output terminal 6. At this time, a diaphragm contrpl.is performed based on the signal obtained from the 
45 pickup element 3 as follows: ; v : 

An image frame luminance average calculation- unit 7 calculates an average luminance of an image 
frame, based on the signal from the pickup element 3. The diaphragm, control unit 8 compares the averag'e 
luminance :wjth a: target luminance obtained by the target |u mi narice calculation unit 9. and controls the 
diaphragm to be . opened or closed so that the difterence between the average luminance and the target 
50 luminance is made 0,- whereby the average.luminance-is kept substantially equaUo the target luminance. 

■ A small region , luminance . .average calculation , unit 10 calculates an average lurninance in 4ach of a 
plurality, of small regions based. on the signal frorri the.. pickup element 3 so as to obtain a luminance order 
characteristic of the luminance levels. . - ! . , 

The 'degree calculation unit 27 calculates an average value of low luminance regions from^ the luminarice! 
65 order characteristic. The average luminance^ of Jow luminance regions Js converted Jn a non-lihea'r manner 
by .'fuzzy .inference or the . like, whereby a backlight , degree Ur representing the degree of backlight of a 
pickup image is calculated. In addition, an average luminance of high luminance regions is calculated ■from' 
the luminance order characteristic, and the average luminance is converted in a non-linear rrianner byVuzzy 
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inference, whereby an excessive frontlight degree w. is calculated 

An image frame is divided into the lower central region 210. the upper region 220, the lett region 
and the right region 240 as shown in Figure 47. 

Now, we introduce the following definitions: avaraae 
(1) A region X is one of the left region 230 and the right region 240. which has a lower average 

%TTZT.TsoToi the left region 230 and the right region 240. which has a higher average 
luminance than the other. 

(3) A first region is a combination of the region Y with the upper region 220. 

4 A second region is a combination of the region X with the'lower central region 210. ^ 
The ffrsrsecond regions luminance average comparison unit 26 calculates an average luminance of. 

each ogion 2d'a diHorence p, of an average luminance between the first region and t^-J-;^ -^;33„ . 

The image frame is also divided into a lower central region 310. an upper region 320. a left region 330. 
= rinht reoion 340 as shown in Figure 48. Now, we introduce the following definitions:' 
,s fv) ATegion. X- Is one Of the left region 330 and the right regioh 340.^ which has a lower average . 

l^TX'Sill^V-t^e of the>1t r.gion-330 and- the^rlght region 340. which has a higher average 
luminance than the other. . ' . - . . oon 

(3') AthirdregionisacorT,binationofthe'regibriX' wit^ , . - ' '■ 

,0 4' A fourth region is acbmbinatioh of the region V with the lower central region 310.- ^ _ 

" ^A,hird);ou;thregionsluminaneeaveragWco'r^,p^^^ . 
r^ninn and a difference P2' of an ave>ag4 luminance between -t^^^ ' 

^ A c^ 'r WmSu^ calcJlafiSn u 815 detects lights^r&W an light source through a prirnary color (^ed 
blue an^gTSTt? and- converts th^ lights'' into ^^leStriil-signais- R; B,' and G. The '"door/outdoor judgr^ent.- 
^ ul?-155 cStes^a ratib art,ohg'% r^d ligfit.-a blOe ^gt^t.rand a gfeen light, based on the electnc signals. 
R and G A control siana! r is calculated from the ratio. ^ . . . ^ i-.^^+c^ 

The p^r^cSlxil the iUdgmer^t betWeeh the 'indbd^i^ffd^^ bbtdoors by using the ratio among the-lights 
with three D'rimWy colors generated from the. light • .. hat 

As S&ibe'a^above, Sis knovvh that a cblor tVmpeHature cM kh Indoor light ^T^I^^'^^J^X^ 
of an outdoor llqht source. The color temperature of dn Indoor light source such as a f'"°''sscentjight is 
genially S to 350O- k; ahd the colbr. temperature of an outdoor light source such as the 

RgW 49°shrs% spectral distribution In the 'case where ' the color temperature of a; 'ight source 
chan?esTrom%000 K to 1S0OO K. Figure 54 shows a relationship t^tween ^-^^ J^^^^;^^^^^ 
transmittance of the three primary color filter. As is understood from Figures 49 and 54. a ^9^^ ^j^^^^^^^^ 
the color temperature calculation unit 815 through the filter corresponds to an area '° '^l^^j^'^^f jll 
broken me of Figure 49 In addition, it is understood from Figure 49 that since the ratio annong the three 
prirl^aVSlors fSererit in accordance With the coior temperature.. the iudgment between the indoors-and 
the outdoors can be made from the ratio-amohg the three primary colors. - , the control 

The difference p, of an average luminance, the difference ps of an average luminance, and the contro 
slgnll r.Tnd th?degrees~of backiight and excessive frontlight are transmitted to the- correction .amount 

'^"tfco^^S amount calculation unit 28 selects the difference p, outdoors and selects the difference 
0. inWs acc<^lg to the control signal r. these selections are based on a tendency that an .n^age f^me 
.5 Ling a brightTght half and a dark left half is likely to be in an excessive frontlight state indoors and the., 
same'image frame is likely to be in a backlight state outdoors.- . . . ' . ^ . . ^ h«rkiiaht state- 

Moreover, the correction amount calculation unit 28 judges an image trame to be in « ^acl^^M s^^e 

direni t oT the difference p. into a gain g used for baiculating a correction amount as^shown in Figure 

5 ThTn a dorrlction Amount ' is cafculated by the ■Formula .(21), based on t»-^^-^'9^^^^^^^^^ J^J 
excessiie frontlight degree the gain g, and the-.result 6. the judgmenl-betwaen the backlight and.. the 

excessive frontiigtit. ' * " ... ... ,\. - • . . 
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The target luminance calculation unit 9 sets a target value of an average luminance of an image frame 
for each vertical scanning (frame or field), by adding the correction amount z obtained by the correction 
amount calculation unit 28 to a predetermined target luminance: The diaphragm control unit 8 regulates a 
diaphragm so thai the average luminance of the image frame is kept substantially equal to the target value. 
5 As described above, an appropriate exposure of an object'for an excessive frontiight image where the 

central region of the image frame in bright and the lower region thereof is dark, an excessive frontiight 
image where an object moves up and down, and a backlight innage where an object moves from side' to 
side can be obtained. 

70 Example 12 

Figure 55 shows the twelfth example of ah automatic exposure control apparatus according to the 

present invention. . 

An. image of an object is fprrr^ed on the pickup elerhent 3 through the lens 1 and the diaphragm '2, and 
75 is converted into an electric signal. The signal is amplified by the amplifier 4. Then, the signal is subjected 
to a -y treatment while passing through the signal processing circuit 5 and is transmitted to the video signal 
output ternriinal 6. At^ this time, a, diaphragm' control "is performed based on the signal' obtained* frphri the 
pickup elernent 3 as follows: , . , . ' .. . . . . ' ' 

An image frame luminance average cal.culatldh* unit 7 calculates an average 'lunriinance 6f' an innage 
20 frame, based on the signal from the pickup element '3. The diaphragm control unit 8 compares the average 
luminance with a target lunrijnance. value obtained by the target luminance ealculatioh unit 9. knd cohtrbis 
the diaphragm to be. opened or closed so that the difference betweeii the average iuminahce and the target 
luminance is made 0, whereby the average luminance is kept substantiailiy equal to the target luminance. ' " 
A small, region luminance average calculatiori unit;'lO calculates an average" luminance in eacfi of a 
25 plurality of small regions based, on the signal from ihe pickup element 3 so as to obtain a' luminance oPder 
characteristic of the luminance. levels. . / . \ 

The degree calculation unit 27 calculates/ah ayeirage value of low' luhrii nance regions from the lurnihance 
order characteristic. The average luminance of loW lumihahce 'regions is converted in a non-linear manner 
by fuzzy inference or the like, whereby a backlight, degree Ur representing the degree of backlight of a 
30 pickup image is calculated. In addition, an average iuminance of high lunninance regions is calculated from 
the luminance order characteristic, arid the average iuminance is converted in a non-linear manner by fuzzy 
inference, whereby an excessive frontiight degree Wr is'calculated. 

An image frame is divided into the lower central region 210, the upper region 220, the left region 230, 
and the right region 240 as shown in Figure 47. 
35 Now, we introduce the following definitions: 

(1) A region X is one of the left region 230 and the right region 240, which has a lower average 
luminance than the other. . 

(2) A region Y is one of , the left region 230 and the rit|ht region 240, which has a higher average 
luminance than the other. . .. ' , . . ' . " . 

40 (3) A first region is a combination of the region Y with the upper region 220. 

(4) :A second region is a combination of the region X with the 1^ : 
. The first/second regions luminance average comparison unit 26 calculates an average luminance of 
each region, and. a difference pi of an average luminance between the first and' second regions. 

The image frame is..also divided into .a .lower central regiori 310, an upper region' 320, a left region 330, 
45 a right region 340. as shown in Figure 48. Now, we introduce the following definitions: ' 

(V) A region ;X\ is one of the left region 330 and the right region 340, which hais a lower average 
.luminance than the oth^r., , / ...... ' . 

(2') A region Y* is one. of the left region 330 and the right region 340, which has a higher average 
luminance than the other. . ' ..'.^ . . . . . , . . ' 

50 (3') A third region is a combination of the region )C' with the upper region 320. 

(4') A fourth region is a combination of tVie region Y' with the lower central region 310. ^ ' 
; A third/fourth regions luminance average comparison unit 315 calculates an average luminance of each 
region and a. difference!. p2 of an average luminance^ between' the third and forth regions. ' 

A color temperature calculation unit, 1010 calculates an average of color difference (R-Y, B-Y) of an 
65 image frame .and calculates a color tenriperature by using, ^the relationship, between' the color temperature 
and the color difference in Figure 56. The indoor/butdopr judgme^^^ a control s'igri'at r 

corresponding to the indoors and the outdoors, based ~ on the calculate.d coloi"- temperature.' The color 
difference shown in Figure 56 is generally calculated in a video camera and the like for the purpose of 

28 



BNSDOCID: <EP 057096BA2..L > 



EP 0 570 968 A2 

adjusting a white balance, and it is not required to modify the structure of a hardware. Thus, the effects of 
inferring the color tennperature by using the color difference are great. . 

The difference p, of an average luminance, the difference P2 of an average luminance, the contro 
signal r. and the degrees of backlight and excessive frontlight are transmitted to the correction amount 

5 calculation unit 28.. j i H;«cronr-o 

The correction amount calculation uriit 28 selects the difference p, outdoors and selects the difference 
P2 indoors, according to the control signal r. These selections are based on the tendency that an image 
frame having a bright right half and a dark left half Is likely to be in an excessive frontlight state indoors and 
the same image frame is likely to be In a backlight state outdoors. 

,0 Moreover, the correction amount calculation unit 28 judges an image frame to be in a backlight state 
when the .first or third region containing the upper region has an average luminance higher than that of the 
second or forth region containing the lower central region; ahd judges an image frame to be in an excessive 
frontlight state when the first or third region has an. average luminance lower than that o the second or forth 
region These judgments are based on the tendency that it is likely to be in a 9^^^^^^;:^^^^"*^^. 

,5 upper region is brighter, than the lower region, and that It is likely to be in an excessive frontlight state when 
the upper region , is darker thah the lower region. Mpreover, the Coi-rection arnount cal9ulat,on unit 28 
converts the difference' p, or the difference p. into a gain g. used for calculating ^7"" 
Shown in Figure 51. Then, a porrecti on. amount z is calculated by the Fornnula (21). based on ^e backlight 
degree ..u. the. excessive frontlight; degree ,w.,. the .^gain,9,> the result of the judgment between the 

20 backlight and .the excessive frontlight.. . , . - , . , . • „ ..^ - •■ 

The target ".iuminance, calculation unit 9 .sets 4. target. .value of an average luminance of an image frame 
for each. vertical scanning, (frait,e..or .fieldj.W.addingH.he correction amount z obtained the correct^n 
amount calculation unit'28 to.a predeterrpined- terget>rnihan The -diaphragm -control unit 8 "-eg^la^es a 
diaphragm so that ,ihe average Juminance of jhe /image fram,e.is kept .substantially ex,ual to the target valua 

25 As described above.' an apprbpriate exposure'of an object for an excessive frontlight image w^ere the-, 
central, region of the. image .frarne ,bright and the. lower region thereof is dark, an ^^^^^^"^^l.. 
image,;where in .object' moves, up Jand c^bwh, an.c^.;..a . backlight image /where an object moves from side to. 

^""^InTheVeSnt^example, the .comparison of lumifti'hce 'bV. the first/secprid. regions luminance averager, 
30 comparison' unit 26\and ,the third^fourth regions luminance average comparisdn unit 315 f Pf ... 
using a luminance difference. It is apparent" th^t. the_^sanne, effects are obtained even though a luminance 
ratio is- used. ... , .. . 
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Figure 57 shows a thirteenth example of an automatic exposure control apparatus according to tt.e 
present invention. The same reference numerals .as those of. the , preceding examples are marked for the 
same components as those of the preceding examples.' The same components as those of the preceding 
examples function in the same way as in the preceding examples. . 

Hereinafter, the operatipn of the .present exarripl.e wili be descritjed. ^. ^- ■ o 

An image of an .object is formed on the pickup element' 3 through the lens 1 and the diaphragm 2; and 
is converted to an electric signal. The signal is amplified by the' amplifier 4. Then, the signa is subjected to 
a ^.treatment while passing through the signal processing circuit 5 and is transmitted to the video signal 
output terminal 6. At this time, a diaphragm control is performed based on. the signal obtained from the 

pickup element 3 as follows: w n < v,„ -.w^o^q 

An image frame luminance average calculation' unit 7 calculates an average luminance Yall of an image 
frame, based on the signal from the pickup element 3. The. diaphragm control unit 8 ^o^ipares the average 
luminance Yall with a target luminance obtained by the target luminance calculation unit 9-. J*^^^ 
diaphragm to be opened or closed .so that the difference between the average luminance Yall and the^ target 
luminance Yair is made tp.bVo, whereby .the, average luminance Yall is' kept substantially equal to the 

target luminance Yair. . . ' . . ; - , k-^^ -^i „ 

A small region luminance average calculation ; unit 10 calculates ah average luminance .n each ot a 
plurality -of -small regions based on' the.^slgnal frohn the pi ckiip. .element 3. The luminance of each srrtaU 
req^ion is presented by an average luminance of pixels in each small region. ' . 

A distribulion detection unit. 145 rearrariges ^the average luminances of the small regions m the order 
from the lowest lo_ the jiigh^t "An average l^aiinarfee^'in a ce^^^ of pixel numbers .s 

calculated by the following Formula (24). . , ^ . .. ; , . : ; > • - , r 
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^2 

V =. rv(i)/(N2"N^+l) ... (24) 

where V is an average value of low luminance regions or an average value of high luminance regions; v(i) is'^ 

a luminance levej of the ith pixel from the lowest iuminance; Ni = 1, N2 = Ndark when an average value of low 
70 luminance regions is calculated; and N^ = N,ight, N2 = Nan = total number of pixels, when an average value of 

high luminance regions is calculated. 

A normalized luminance calculation unit 150 calculates the ratio of the average vale of low luminance 

regions to the average luminance of the image frame or a ratio of the average value of high luminance 

regions to the average luminance of the image frame. 
75 Specifically, the normalized luminance calculation unit 150 calculates a normalized average value of low 

luminance regions or a normalized average value of high luminance regions by using the following Formula 

(25)..^ ... / . v-.. ■ /.^ ; ; \ ; ■ . • - • . , 

Vr, = K4 -VA^all (25) . . ^ , : : . . ^ ^ . 

20 .. .... - ■ - ■ 

where Vnv is a normalized, average. value of low lurhi nance regions or a normalized average valLie of high 
luminance regions; V is an average value of low lurninance regions or an average value of high luminance 
regions; Yall is ah average luminance of an image frame; and K4 is a gain. ' • ' 

A backlight or excessive frontlight degree calculation unit 130 calculates the degree of backlight or 

25 excessive frontlight by using the normalized averagfe value' of low luminance, regions or* the normalized ' 
average value of high luminance regions. For example, the degree" of backlight is calculated by using the- 
following Formula (26). 

Udark^ = Kv*(cv-Vm)^ " (26) ' ' ' V;^'";/;; ^ ' \ ^ ■ ' • ; ■ ■ ^ 

30 ^ ^ . . _ _ , " \ ' ' ' ' ' • ^ :■ . : 

where Udark- = 0 when d - < 6; Udark- is a backlight degreie. Kr Is a gain, arid Cv is a constant. 

The target luminance calculation unit 9 sets a target value of an average luminance of an irhage frame 
(i.e., a target luminance Yali') for each vertical scanning (frame or field), based on the backlight 'degree or 
the excessive frontlight degree obtained by the backlight or excessive frontlight degree calculation unit 130. 

35 The diaphragm control unit 8 regulates a diaphragm so as to keep the average luminance Yall of an 
image frame substantially equal to the target luminance Yair. ^ 

When a diaphragm is changed, a change anrioynt of the backlight degree Udark- obtained by using the 
normalized average value Vny of low' lunriinance regions is snialler than that of the backlight degree Udark" 
obtained by using the average value V of low luminance" regions. This reason vvlll be described below. 

40 \A/hen a diaphragm is opened, each pixel in an image frame becomes bright;"so that the average 
luminance of an image Jrame Yall and the average value V of low lunnlnance regions becomes small. When 
a diaphragm is regulated in a closing direption, "the. average luminance of an linage frame Yall and the 
average value V of low luminance regions become small.. Thus; a value obtained by dividing the average 
value, of low luminance regions by the average luminance of an Image frame, i.e., a normalized average 

45 value, of ipw luminance regions Is not likely to' be influenced by the change of the average value of low 
luminance-regions .due to the change of the diaphragm. For this reason, a target luminance which Is not' 
influenced by the state of a diaphragm can be calculated by employing the backlight degree obtained by 
using the. normalized average value of low luminance regions, and one correction amount of a diaphragm is 
defjned for one image. ^ - - . ... - 

50 ..-J^he same . principle as the above can tpe applied to the case where the excessive frontlight degree' is 
calculated, by using high jumiriance regions in an imag^^ 

As described above, according to the present exairipfe, the ratio betvveen the average luminance of an 
image -frame and the. average value of Ipw luminance regions or the average value of high luminance 
regions; - is , used for cjalculating a backlight "degree or an. excessive frontlight degree. Thus, a target 

55 luminance which is not influenced by the st^ate.pf a diaphragm can be obtained'^ and bne Correction amount 
^ of a diaphragm can be defined for one Image. = ~ • ■ ■ . ; ^ . 

r In the case where luminance. of each'pixel in anjnna'gy'fra^^^^ linearly changed along with the change 
of a diaphragm, the average value of. low luminance 'region's or the average value of high' luminance regions- 
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is Changed in a constant amount with respect to the change of the average lunninance of an innage frame^ 
Therefore The use of a ratio of the average value of low luminance regions or the average value of high 
luminance regions to the average luminance of an image frame is effective in calculating the target 
luminance However, in an actual system, the dynamic range of a pickup element causes a saturation of a 

5 video signal corresponding to a brightness more than a predetermined level. In particular, an .mage in a 
backlight state or an excessive Irontlight state has high contrast, where a bright region and a dark region are 
clearly divided, so that pixels In high lumiriance regions are likely to. be saturated. In this case, lunninance of 
each" pixel changes with respect to the. change of a diaphragm in a non-linear manner. Thus, the average 
luminance of- an image frame, the average value of low luminance regions, and the average value of high 

,0 luminance regions change at a different rate with respect to the change of a diaphragm. Example 14 shows 
a method for coping with non-linearlity of luminance due to the saturation of a video signal. 

Example 14 

,s A method for calculating a target luminance by using a difference between the average luminance of an 
imaqe frame and the average value of low ' luminance regions 'or the average value of high luminance 
regions will be described. According to this method, the effects of the saturation of high luminance signals 
are made as small as possible and the target luminance which does not depend on the change of a 

diaphragm is calculated. ,. j _ » „ 

20 -The normalized luminance .calculation unit 150 as shown in. Figure 57 calculates a normalized average 
value <)Mow lurninance /egions or a.! normalized average, value of high luminance regions by using the 
following Formula (27). , . .. ... .. , .. ... ... : 

Whep V,is an average value Of low luminance region^ '. , . 

25 When V is an.average -value.'of, high luminance, rje^iqns: y^2\ = ,^5 ' (V - Yall) (27) - _ <^ 

where V„p is a normalized average value of low luminance regions or a normalized average value of high 
luminance regions: V is an average value of low luminance regions or an average value of high luminance 
regions; Yall is an average luminance of an image frame; and Ks is a gain. ' , u . , 

The backlight or excessive frontlight degree calculation. unit 130 calculates the degree of backlight or 
excessive .frontlighV-by^using the nVrtiali.zed average^aiue of,low luminance regions or the normalized • 
average value of high lurninance regions, For exarfi;pre,,;^e, backlight degree is calculated by the following - 
Formula (28).. . , ; .. : . .. , ; • ..■ 

35 Udark- = Kr ''(V„2-Cr) (28) ■ ' ^ . , 

where U,,a.r = O.when V„2 .-. c,-- <.0; Ua^r.- is a backlight degree; Kv .is a gain; and Cv is a constant. ' ; 

The backlight degr^b obtained as 'described above changes less than a backlight degree conventionally; 
obtained by using' an average value of low lumiriance regions,, With respect to the change of a diaphragm. 
40 The principle Of this phenomenon will be described' belovy. .. , ,. ■ » + 

When high luminance signals are. saturated, eac'h lurihinance of the saturated regions becomes constant. 
As a result the number of. pixels, of which , luminance increases when the diaphragm is opened is 
decreased -Accordingly, when the diaphragrh is opened so as to Increase the average luminance of an 
image frame by a predetermined amount of Aa, an increase amount in unsaturated regions is also 
45 increased'. Thus, when the high luminance signals .are not saturated, the increase amount Aa of the average 
luminance of an' image fr^me is larger than an increase amount Av of the " average ■ luminance of low 
luminance regions. However, when .the high luminance sighals are saturated, the'increase amount Av may 
become the sar^e as, or greater than the increase amount Aa. Since the change amount of the normalized 
average value of low luminance regions when the.diaphragm is opened depends on the difference between 
50 the change amount Av and the change amount Aa. .(i.e..; Av - Aa). Therefore, when the respective change 
amounts are the same, i.e.. Av = Aa. the normaUzed .average, valine of low luminance regions hardly change 
with respect to the change of the diaphragm.. . ' . ' . ; . . 

. In the case where the high luminance, signals are riot saturated, an image is not likely to require an 
exposure correction. Thus, ' a cbrreption . amount .is set at a small value from the beginning. Accordingly, a ' 
55 target luminance is hardly influenced by thei change of a diaphragm. '. . ' . ' . . 

As is understood from the above-mentioned ^lescription. the change'of the backlight degree obtained by 
using the normalized average value of low luminartce .Vegions is' smaller than that of the backlight degree 
oijtained without using the normalized average value of low Iuminanc6 regions. 
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Likewise, when the high luminance portions in an image frame are used for detecting the excessive 
frontlight degree, the influences of the change of a diaphragm are small. 

According to the present example, a target luminance is calculated by using the difference between the 
average luminance of an image frame and the average value of low luminance regions or the average value 
5 of high luminance regions. Thus, the target luminance which Is less influenced by the change of a 
diaphragm can be calculated under the condition that high luminance signals are saturated and one 
correction amount can be defined for one image. 

Example 15 . . 

A fifteenth example of ah automatic exposure control apparatus according to the present invention will 
be described. ; ... . 

As described in Example 14. when the diaphragm is opened so as to increase an average luminance of 
an image frame by a predate rnnined amount Aa under the condition that high luminance signals are 

15 saturated, .the increase amount' Av of ari average value of low "luminance regions becomes larger than that 
of an average value of low luminance, regions under the cbnditlon that high fuminance signals are not 
saturated. Thus, a ratio of ah average vajue of low luminance regions to an average luminance of ah image 
frame^ (Ydark/Yall) under the condition that the high luminance signals are saturated becomes larger than the 
same ratio under the condition that the high luminance signals are nbt saturated. " ' - 

20 It is- assumed that an apparent average iummahci^' of an innage frarne Y^^^u is set so that the Increase ^ 
amount .Aa' thereof, becomes larger than the. increase amount Av when'fhe diaphragm is opehed so as 'fo ' 
increase the average luminance, of an irpage frame, by Aa Jh this casb, a r^tib' c^^^ 

becomes smaller than ^Ydark/Val I.. Accordingly, -a tarQ^t iuriii nance which is less influenced by the^changJof 

a diaphragm can be obtained under the conditions, that h'igh iuniinarice signals^ are saturated; ' 
25 In the case where high luminance signals are hot saturated,' an image' is not likely to require an 

exposure correction. Thus, a correction amount is set at a small value from the beginning. Accordingly, a- 

target luminance is hardly influenced by the change p^'^a diap^ ■ ' 

As described above, when the b^kljg hi degree 1s ^c^^^^ luminance of ah image framb ' 

Is converted into an apparent average luni/narice thereof anij a ratio of an average value of' low luminance' 
30 regions to the converted value is obtained. According to this calculation, a target luminance which is hardly 

influenced by the change of a, diaphragm, can be rriore. easily obtained, compared with the case using a 

ratio of an average value of low luminance regions to ah average luminanc^ of an image frame. 

In the present example, when the average luminance of an image frame Yall is converted into the 

apparent average luminance of. an image frame Yn_a,j, the apparent average luminance Yn_aii is set so that 
35 the ratio of the increase, amount Aa* of the apparent average luminance to the increase amount Aa becomes 

large. -The target luminance is calculated by using the ratio of the average value bf low luminance regions td 

the apparent average luminance of an image frahne. ' 

More specifically, the hgrmalized juminance calculation unit 150 calculates a hbrmaiized average value " 

of low. luminance regions by using the. Formula (29). ^ ' - ^ - 

40 ' r - 

Yn_all = K7 * Yall + C4 (29) 

where Vns is a normalized average value of low luminance regions; V is an ai/erage value of low luminance 
45 regions; Yall is. an average luminance of an image frame; Kg , are gains, and C4 is a constant. 

As is understood from Formula (29). the apparent, average luminance of an image frame Yn_ai, is 
calculated so.that the ratip AaVAa becomes large against the change^of the diaphragm, and then the ratio of 
the average value of iow luminance regiops to the .Yn_3,, ' is' calculated, This ratio changes less than "the ratio 
of the average value of low luminance regions to Yall. due' to the change of a diaphragm. 
50 The backlight or excessive frontlight degree calculation unit 130 calculates the degree of backlight 
employing the normalized average value of low luminance regions by the following Formula (30). 

UdarkV;?= Krv " (Cv - Vna) . (30) . . , ' ' • . 

55 where Udark- = 0. whea cr-' - Vn3 < 0; Udark 'vi.s.^ backlig^^^^^^ Ky.: is a^ gain;; and Ci - is a constd^ht. ' 

. According to. the present example, the, a vera(ge\lunni nance 'of an image frame is coriveried^ into the' ' 
apparent average luminance of an image. frame by the'.^ormula (29), a^ luminance is calculated " 

Vby using the ratio of the average value of .low luminance 'regions to the converted value. Thus, even' when ' 
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the high luminance signals are saturated, the target luminance which is hardly influenced by the change of 
a diaphragm can be obtained and one correction, amount can be defined for one image. 

Example 16 ^. 

A Sixteenth example of an automatic exposure control apparatus will be described with reference to 
Figure 58 The same reference numerals as those of the preceding examples are marked for the same 
components as those of the preceding examples. The same components function in the same way as in the 

Drecedinq examples. , ^ . . . ^ ^.^^^ 

in the present example, a backlight degree and .an excessive frontlight degree are obtained .n the same 
way as in Example 15. In addition, two degrees are selected according to the '"dgment between he 
backlight and the excessive frontlight. whereby an exposure control is performed with respect to both of the 
backlight and the excessive frontlight state. . .■ an- 

The calculation units 21 and 24 calculate an. average value of high luminance regions V„gM and _an 
average value of' low luminance regions V<,„„ respectively. These calculation units 21 and 24 correspor,d to 
the drstribution .detection unit 145 of Example 13. A normalized low luminance average =^'f 1^1^*'.°"^^"'^.^^ ., . 
and a normalized high luminance .average calculation unit . 36 normalize an average value" of low lum na^^^^^ 
reoions V,„, and an average value of high luminance .regi.o.ns. V,,,,. with an average luminance of an image 
frame Yal respectively. The normalized lov. luminance average calculation unit 35 and the normalized high 
luminance average calculatibn. unit 36 correspond .to the .normalized luminance calculation unit 150 of 
Example 13. A normalized average value of.lovy luminance regions V„_,„K.and a normalized average value 
of high luminance regions v7„ are input into the; backlight degree calculation unit 2a and excessive 
frontHght degree calculation unit 25. Jhe calculation units .20 and 25 calculate a backlight f^^ ^^^^^^^^, 
an excessive .frontlight- degree U„,„;in .the same way . as In th^ backlight or excessive frontlight degree 

25 calculation unit 130' Of, Example 13.. , , , , .. ., . . - u r. t::r,„r^ «;<» An* 

An image frame is divided into a upper; region and .a lower region, as shown in F'9»^re 59. An 
upper/lower regions .luminance average comparison, "unit 231 calculates an average luminance of the uppe^^ 
Son.t Jthe^lower'bgion, based.bn the .signals ;frbm,,;the p^^^ element 3.. Then the upper/lower regions^ 
luminance .average comparison unit.231 calculkes VlMminance difference .by the following Formula (31). • 

Luminance difference =. (Average luminance of the 'upper _region) - (Averag^ luminancd of the lower region)-.- 
(31). -:• .. . ■ ■ ■ .'V ... " ' . ■ • - ■' . . ; 

Moreover. ;the upper/lower regions luminance^ aveVage comparison Jnit 231 '7'"^"?^;.. 
difference into a judgment value p within an interval [^l. 1]. The judgment value p is used to judge betw^h 
backlight and excessive frontlight. The cbnversion diagram from, the luminance difference to the judgment 

value p is shown in Figure, 60. . - ■ i^i^.^r^^ mo 

The correction amount calculation unit 28 determines a final correction employing the 

backlight degree U.ark, the excessive frontlight degree UngM. and the judgment value p of the backl.ght-and 
40 excessive frontlight by the following Formula (32). . . , _ 

If p < 0. then 2 = Uiight * P 

If p.> 0. then 2 = Udark * P , , (32) . . . ^ . 



30 



35 



45 



The target luminarice calculation unit .9 sets a target value of an average lunfiinance o an image frame 
for' each vertical scanning (frame or. field), by. adding the 'correction amount z obtained by the correction 
amount 'caiculatioo unit 28 to a predeterrT,inecl target,luminance. .Specifically, the target luminance calcula- 
tion unit 9 calculates a target lurriinance Yair by the following Forrnula (33). _ . 



so Yail' = Yinit • (l + z) ' (33) . 



55 



where Yinit is an initial target luminance. .. . ., -.^o^i Trarrvo 

The diaphragm control unit 8 regulates a diaphragm so that the average luminance of an image frame 
Yall is kept substantially equal to the. target luminance Yall". When an upper region of the image trame is 
brighter- t'L a lower r^giori' thereof; the image fr^'me is' jubged to be in a backlight slate.'Then. a correction 
is made' based on the backlight degree' pbtainedTroria.ihe'lower region. When the upper region ol the innage 
frame is' 'darker* than the lower region thereof,- the image frame is judged to be in an excessive frontlight 
state Then a correction is 'made based bn tKe excessive'frontlight degree obtained from the tower region. 
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As described above, according the present example, an average value of low luminance regions and 
that of high luminance regions are converted into values which are not influenced by the change of a 
diaphragm, by using the average luminance of an image frame! The backlight and excessive frontlight 
degrees are calcujated using the respective converted values. Each degree is selectively regulated, based 
5 on the luminance difference between the upper and lower regions. Thus, one target luminance can be 
defined for both of the backlight and excessive frontlight states. 

In the . present example, the backlight degree is calculated from the average value of low luminance 
regions; and the excessive frontlight degree is calculated from the average value of low luminance regions 
or the average value of high luminance regions.' lUs also possible that' a plurality of ranges of pixel numbers 
10 are selected as shown in Rgure 61, and average luminances of the respective ranges are integrated by 
fuzzy inference or a linear nrtuitiple function, whereby the backlight and excessive fronttight degrees are 
obtained. Thus, it is ajDparent that the same effects can be obtained even in the follDwing case: A plurality of 
average luminances, are converted so as not to be influenced by the change of a diaphragm and integrated 
by fuzzy inference or a. linear multiple function, whei-eby the backlight and excessive^ frontlight degrees are 
76 obtained. ' ' . ' : . 

In the present example, an exposure correction using a diaphragm is described. However. It is apparent 
that an exposure correction in accordance with calculated backlight and excessive frontlight degrees can be 
achieved similarly by correcting a gain of a y correction circuit and a gain of . an AGC circuit in the signal 
processing circuit. 

20 In the present example, the judgment between the backlight and the excessive frontlight is made by 

using the. luminance . difference^between the upper and lower regions, the judgment can also* be 'made by 
using, the luminance ratio therebetween. ' ' : ^ ;i. - ; : 

According to the present invention, an image frame is divided into small regioris, and the d^gi-ee of 
backlight under an automatic exposure control can quantitatively be obtained from low luminance regions in 

25 the image frame. In addittpn, the judgrherit between; the backlight and th^ excessive frontlight is^ made 
based on the luminance,ratio between upper and lower reg^bns, ,^nd"the correction artiount of a diaphragm 
can be regulated. Thus, an automatic exposure cdntroi apparatuis which can appropriately change the 
control. level of a diaphragm ip accordance with an image state can be provided. ' ' 

Moreover, the autornatic' exposure contror appWa^^^ accoVding to the [bresent inve^^^^^ a 

30 calculation unit for calculating a luminance difference between firsf and second regioris. Because 

misjudgments are made with respect to ah excessive frontlight ihaage where an object moves up and down; 
a backlight image where an object moves from side to side; a backlight iniage where a dark substance gets 
in and out of one side of the image frame; and a backhght image where a bright substance gets in and out 
of one side of the image frame. Furthermore, the' automatic exposure cdntrorapp^ratus according to the 

35 present invention includes a first judgment unit for judging between the backlight and the excessive 
frontlight by the average luminance comparispn results of the first and second regions; and a second 
judgment unit for judging between the backlight and the excessive frontlight by a luminance ratio between 
the upper and lower regions. Because of 'this, no misjudgments are made with respect to an excessive 
frontlight image in which an object moves up and down; a backlight image where an object moves from side 

40 to side; a backlight image where a dark substance gets in and out of one side of the image frame; and a 
backlight image, where a bright substance gets in and out pf one side 5f the image Mrame! "Thus, it is 
practically effective to apply the apparatus of the present invention to a video carriera or the like which is 
under the condition that an object is moving arid where the above-mentioned states are likely to be 
generated- 

45 Furthermore, the automatic exposure control apparatus according to the present invention includes a 
correlation value calculation, unit for calculating the correlation value of an average luminance of each small 
region normalized with, an average luminance of an. imag§ frame and a predetermined luminance distribu- 
tion. Becausp. of this, an exces$ive frontlight irinage; where the central region of an image frame is bright is 
recognized, avoiding misjudgments. An appropriate exposure control can be performed with respect to an 

50 excessive frontlight image where the central region of the image .frame is bhght, a backlight image where an 
object moves from side to side, and an excessive frbritlight'^irpage where an object moves up and down. It is 
practically effective to apply the apparatus of the present invention to a video camera where an excessive 
frontlight, state is generated >vhen photographing in front pf a.vyindow and where an object moves. 

Furthermore, according to the present invention, the' judgment betw^^ indoors" and the outdoors is 

6b made with respect to an image'having a bright right half and a dark left half When the 'tumihance of the 
upper region is lower than that of the lower region indoors, it is judged to t)e [n an excessive frontlight state. 
When the luminance of the upper region js. higher" tKgn thaVc^^^ tf;ie lowei- region outdoors, it is judged to be 
in a backlight state. Because of this, no misjudgment is made with respect' to the im^ge arid an appropriate 
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exposure control can be perlormed. It is practically effective to apply the exposure control apparatus of the 
present Invention to a video camera or the like which will be used indoors and outdoors. 

Furthermore, according to the present invention, an average value of low luminance regions or high 
luminance regions is converted with an average luminance of an image frame into' a value which is hardly 

5 influenced by the change^ of a diaphragm. A target value is calculated by using, the converted value, 
whereby the. target value corresponding to each image is obtained and a diaphragnr> control appropriate for 
the contents of an image is made possible. In addition, according to the present invention, one target 
luminance is determined with respect to each image, so that it is not required to consider the change of a 
correction amount due to the change of a diaphragm, making it easy to regulate a correction amount 

JO defined by a backlight and excessive frontlight degree calculation unit.. Moreover, the change of the target 
luminance caused by the. change of a diaphragm, which has been the conventional problem, is decreased, 
making possible a stable diaphragm control. . , .„ ^ ■ 

Various other modifications will be apparent tb and can. be readily rriade by those skilled in the art 
without departing from the scope and spirit of this invention. Accordingly, it is not intended that the scope of 

75 the claims appended hereto be limited to the description as set forth herein, but rather that the claims be 
broadly construed. - . . . " - 

Claims - • - . • : 

20 1. .An automatic exposure control apparatus comprising:. ... ^ _ 

image frame luminance calculation means for calculatirig an average luminance of an image frame; 
..region luminance .calculation m^an.s for .calculating average lumiri^nces .of a plurality of regions, 
said plurality of regions constituVing said image frame; . . . , 

select region luminance calculation means foi-; arrangirig said .average .luminances obtained by said^ 
25 region luminance calculation rtieans in .the luminance order, for selecting at least one of said plurality oi 
regions.,'ac.cording .to said lucninance" order, ;^n(j'f^^^ an average luminance of said selected^ 

regions; , i ; - — • . - . , - . , 

. backlight degree calcuiatlon; means Jof calculatirig a value representing a backlight degree based 
on said average luminance obtained by said select region I urn i nance caiculatiqn means; ' . ^ 

30 target' iumina'nce calculation means for calculating ,a target ^average lunninahce for an exposure 

correction based. on said' value; and - \ u,* • ^ k ■ 

. exposure correction means for correctingan exposure so that said average luminance obtained by^ 
said image frame", luminance . calculation means^is kept substantially equal to said target average- 



luminance. 



2. The automatic exposure control apparatus according to claim 1 . vvherein said select region luminance 
calculation means selects the predetermined number of regions having low average luminances of said 
plurality of regions. . .• , ^ . : • : . ■ 

40 3 'The automatic exposure control apparatus according to claim 1. wherein said value representing said' 
backlight degree is' calculkted by u = k^cl - V)/where u. k. cl and V represent said valuera gam. a 
constant and .said average iuminance obtained by saicJ seject region luminance calculation means, 
respectively." and if cl - V < 0 then Ci = 0. 

45 4. The automatic exposure control apparatus according to claim 1. wherein ' _ 

' ' said select region luminance calculation means arranges said average luminances obtained by said 
region luminance calculation means in the luminance" order, groups said plurality of regions into a ^ 
plurality of sets according to said luminance order, and calculates an average luminance of each' set of 

said plurality of sets; ~' ^ , - - . ^ ■ u. ^ " ' ^ 

50 .said backlight degree calculation means calculates .a value representing a backlight degree based 

on said average luminance of eabh set of said "plurality of sets. , . . ^ 

5. The automatic exposure" control apparatus according to' claim^ 1. wherein ^said' value representing- said 
backlight degree is calculated according to the rule^'of the fuzzy 'inference. - * ^ ' ' _ "^^ . 

6. * the automatic exposure; conuol apparatus adcoVding; to clainh l. wherein ;^aid value representir^g said'^ 
" . backlight* degree'is calculated' according to a linear multiple function. ; , ' 
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7. An automatic exposure control apparatus comprising: 

state judgment means for judging whether an image frame is in a backlight state or in an excessive 
frontiight state; 

image frame luminance calculation means for calculating an average luminance of said image 
5 frame; - . 

region' luminance calculation means for calculating average luminances of a plurality of regions, 
said plurality of regions constituting said image frame; 

first select region luminance calculation means for arranging said average luminances obtained by 
said region luminance calculation means in the luminance order^ for selecting at least one of said 
10 plurality of regions according to said luminance order, and for calculating an average luminance of said 

selected regions; 

second select region luminance calculation means for arranging said "average luminances obtained 
by said region luminance calculation means in the luminance order, for selecting' at least another one of 
said plurality of regions according to said luminance order, and for calculating an average luminance of 
75 said selected regions; 

tpacklight degree calcuiation means for calculating a first value representing a backlight degree 
based on said average lunriinance obtained by said first select Vegion luminance calculation means; 

excessive frontiight degree calculation m^r^s for calculating a second value representing an 
excessive frontiight degree based on said average luminance obtained by said second select* region 
20 luminance calculation means; ' ^ ^ • ' • 

. , correction, amount determination means for determining a correction amount based on the judg- 
ment result by said state judgment means, said first value and said second value; ' ■ 

target luminance calculation means for calculating i target average luminance for an exposure 
correction. based on said correction amount; and - * ' ' ■ 

25 exposure correction means for correcting ah exposure so that said average luminance -obtained by 

said image frame luminance calculation medns 13 kept substantially equal to said target average 
luminance, 

8. The automatic exposure control apparatus a^cordin^ to claim 7, wherein said irn age frame- includes an 
30 upper region and a lower region, said state judgrpeht means compar average luminance of said 

upper region with an average luminance of said lower region, and judges whether said image frame is 
in a backlight state or in an excessive frontiight state based on the result of comparisori. ' 

9. The automatic exposure control apparatus according to clainh 7, wherein said first select region 
35 luminance calculation means selects the predetermined number of regions having low average 

luminances of said plurality of regions. ' ' . . : . 

10. The automatic exposure control apparatus according tb 'claiim 7, wherein' said second' select region ' ' 
luminance calculation means selects, the predetermined number of regions having high average 

40 luminances of said plurality of regions. - . . . • 

11. .The automatic exposure control apparatus according to claim 7, wherein said second select region 
luminance, calculation , means selects the predetermined number of regions having low average 
luminances of said plurality of regions. — 

45 ' ' ' 

12. The autonnatic exposure control apparatus according to claim" 7, wherein said image frame includes a 
lower central region, an upper region, a left regidn and a right region; £ ■ , 

- said state judgment, means, compares an average luminance of a first region with an average 
luminance of a second region and judges whether s^id image frame is in a backlight state or in an 
50 e><cessive .frontiight state based on the result of comparison; 

where, said first region is a "combination ^of said upper' region with one of said left region and said 
.. . right , region, which has a lower average luminance than the otheir,' and sai^^d second region Is a 
. cpmbination ,of said lower/central region with' one of said 'left region and said right region, which has a 
higher average luminance than the other. , ' ''^ : - * 

13. The automatic exposure control apparatus according to claim 12,' whereVh the sum of the Vertical length 
^ of said left.region and the vertical Jengfh of said upper region is smaller than the vertical length of said 
. image frame, and the sum of a vertical length of said right' region and said vertical length of said Dpper 
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region is smaller than said vertical length of said innage frame. 

14. The automatic, exposure control apparatus according to claim 7. wherein said image frame includes a 
first upper region and a lower region; 
5 said image frame also. includes a lovyer central region, a second upper reg.on, a left region and a 

riglit region; 

. said-state judgment nneans includes: _ , ^. ^ • ' 

(a) first/second region comparison rfieans fp'r comparing an average luminance of a frst reg.on with 
, an average luminance of a second region and for generating a first judgment value indicating the 

10 result of comparison, ^ ... . ^^^^ 

(b) upper/lower region comparison means for comparing an average luminance of said first upper 
region with an average luminance of said lower region and for generating a second judgment value 
indicating the result of comparison, anc^ . , . . . 

(c) judgment means for judging whether said image frame is in a backlight state or .n an excessive 
,5 frontlight state based on said.first judgment value and said second, judgment ^alue; . 

where said first region is a combination of said' second upper region .with one of said left reg.on 
and said right..region,^ which has a loyver, average luminarice than the other, and said second reg.on is a 
combination of said .lower central region, with one of said left region and. said nght reg.on. wh.ch has a 
higher average luminance than the other. , - . - . ^ 

'° 15. The automatic exposure.cpntrpl'apparat to claim'V; ^herein saiji image frame includes a 

lower-;Central regi9n, ^an upper region ... 

said state judgment means includes: _ , "c- x ■ ' -fK 

. (a),first/second region comparison means for, comparing an average luminarice of ^.^'^^ 

25 ... .: an. avenage Vuminance.qf ..a second . region, and :ip^g|nerating a judgment value ind.cat.ng the result^ 

SrcorreSron calculation means tor calculating a correlation value representing a correlation 
..... relationship between .the distribution .of. said average luminances obtained by region luminance^ 
calculation means and a'predeWmineddistrlbutipri of luminances, and 
30 - ■ (c) judgment means ^for judging whether said image frame is in a backlight state or in an excessive 
frontlight state based" on said judgment vaM. and said.correlation value; 
where said first region is a combination of said upper region with one of said left reg.on and said 
right region, which has a higher- average luminance than the other, and said second ^egio" 'S a 
combination of said lower central region with .one of said left region and said nght reg.on, wh.ch has a 
35 lower average luminance than the other. . , - ; 

16. The automatic exposure control apparatus according to claim 7, ^wherein said image frame includes a 
central region and a peripheral region;, , . . . , vinht 
said image frame also includes a lower central region, an upper region, a left region and a right 

40 region; 

said state judgment means includes: , - - ^ ^- x ■ 

■ (a) first/second region comparison means for comparing an average luminance of a first region with 
' an average luminance of a second region and "for generating, a first judgment value .nd.cat.ng the 

. 45 .(brcentr5°rBgro.^Smparison means for comparing an average luminance of said central region with . 

■ ■ an average luminance of said image frame and for; generating a second judgment value ind.cat.ng 

..the result of comparison, ... , . ■ ^ „^,„^^t\,c\„c, 

■ (c) correction means for correcting said first judgment value based or) sa.d second ludgmenf value. 

50 (dTiudgment means for judging whether ^aid image frame' is in"a backlight state, or in an excessive 

'frontlight state based on said corrected first judgment value; . _ . 

where said first region is a combination of said , upper, region with one of said left region and said 
^ right region, which has' a higher average iJrfiinance than fhe other, and said second" region .s a 
combination of said lower central region with one of said left region and said right region, which has a 
55 lower, average; luminance than the Other. . ..... • 

17., Th^.aiitomatic exposure-control ap^^^^ tSclaim> wherein saib image frame includes a 

first upper region and a lower region; 
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said image frame also includes a lower central region, a second upper region, a left region and a 
right region; 

said automatic exposure control apparatus further Includes indoor/outdoor judgment means for 
judging whether indoors or outdoors; 
5 said state judgment means includes: - 

(a) first/second region comparison means for comparing an average luminance of a first region with 
an average luminance of a second region and for generating a first judgment value indicating the 
result of comparison, 

(b) upper/lower region comparison means for comparing an average luminance of said first upper 
region with an average luminance of said lower region and for generating a second' judgment value 
indicating the result of comparison, 

(c) select means for selecting one of said first judgment value and said second judgment value 
according to the result of judgment by said indoor/outdoor judgment means, and 

(d) judgment means for judging whether said image frame is in a backlight state or in an excessive 
76 frontlight' state based on said selected judgment value; ' 

where, said first region is a combination of said secorid upper region with one of said left region 
arid said right region, which has a higher average luminance than the other, and said second region is a 
combination of said lower central region with one of said left region and said right'region, which has a 
lower average luminance than the other ' ' . ^ ' -. ^ ... , ' / 

20 

18. The automatic exposure" control apparatus accbrdirig to clairn 17! wh^ said indoor/outdoor judgment 
means includes: * , . -.^^ - . r - . ^ i 

(a) detecting means for detecting infrared rays, 

(b) conversion means for converting said detected infrared rays Into an electric signal, and 
^5 (c) judgment means for judging whether indoors or outdoors based on said electric signal. 

19. The automatic exposure control apparatus according to claim 17, wherein said indoor/outdoor judgment 
means includes: 

(a) dividing means for dividing said average luminance obtained by said Image frame luminance 
30 calculation means by a diaphragm value, 

(b) judgment means for judging whether indoors or outdoors based on the result of division by said 
dividing means. 

20. The automatic exposure control apparatus according to claim 17, wherein said indoor/outdoor judgment 
35 means includes: 

(a) detecting means for detecting a color temperature, 

(b) conversion means for converting said color temperature into an electric signal, and 

(c) judgment means for judging whether indoors or outdoors based on said electric signal. 

The automatic exposure control apparatus according to claim 17, wherein said indoor/outdoor judgment 
means includes: 

(a) first calculation means for calculating an average of a color difference of said image frame, 

(b) second calculation means for calculating a color temperature based on said average of said color 
difference, 

(c) conversion means for converting said color temperature into an electric signal, and 

(d) judgment means for judging whether indoors or outdoors based on said electric signal. 

22. The automatic exposure control apparatus according to claim 1, wherein said backlight degree 
calculation means includes; 

50 (a) normalization means for normalizing said average luminance obtained by said select region 

luminance calculation means, and 

(b) calculation means for calculating said value representing said backlight degree based on said 
normalized average luminance. 

55 23. The automatic exposure control apparatus according to claim 7, wherein said backlight degree 
calculation means includes: 

(a) normalization means for normalizing said average luminance obtained by said first select. region 
luminance calculation means, and 
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(b) calculation means for calculating said first value representing said backlight degree based on 
said normalized average luminance; , 
said excessive frontlight degree calculation nneans includes: 

(a) normalization means for normalizing said average lunninance obtained by said second select 
5 region luminance calculation means, and . - .. . 

^ (b) calculation means for calculating said second value representing said excessive frontlight degree 
based on said normalized average luminance. 

24. The automatic exposure control apparatus according to, claim 7, wherein 

70 said select region luminance calculation means arranges said average luminances obtained by said 

region luminance calculation means in the turr^inance .order, groups said plurality of regions into a 
plurality of sets according to said luminance order, and. calculates an average luminance ojf each set of 

• said plurality of sets;.^ - ' ^. . . 

said backlight degree calculation means calcutates a value representing a backlight degree based 
75 on said average luminance of each set of said pluraHty of sets. • r ^ 

25. .The automatic exposure .control apparatus according to claim 7,; wherein said value representing said 
backlight degree is calculated according to the rules of the fuzzy Inference. 

20 26. The automatic exposure, control apparatus according, to .claim 7. , wherein said value representing said 
backlight degree is calculated according to a linear multiple function. 
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® Automatic exposure control with regard W bapkirght.: -^ *; - 

@) An automatic exposure control apparatus in- 
cludes an image frame luminance calculation unit for 
calculating an average lunninance of an image frame; 
a region luminance calculation unit for calculating 
average luminances of a plurality of regions, the 
plurality of regions constituting the image frame; -a 
select region luminance calculation unit .for arranging . 
the average luminances obtained by the region lu- 
minance calculation unit in the luminance order, for ■ 
selecting at least one of the plurality of regions 
according to the luminance order and for calculating 



an average luminance selected from at least one of 
r.,rthe:^'plurality of regions; a backlight degree calcula- 
• "tion unit^fbr calculating a value representing a bac- 
:"T.k!rght- degree based on the average luminance ob- 
' tained^by the select • region luminance calculation 
unit; a target lurninance calculation unit for calculat- 
. ing the target average luminance based on the val- 
■ ue;^and an -expdsiWe- correction unit for correcting an 
exposure so that the average luminance obtained by 
the image frame luminance calculation unit is kept 
substantially equal to the target average luminance. 
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